00000001:02000400:0.0F:1790736000.436447:0:2964:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg305-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1790736019.042828:0:3183:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg305-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1790736021.140944:0:3227:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 645 MB/s 00000001:01000000:2.0F:1790736021.392693:0:3227:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 694 MB/s 00000001:01000000:1.0:1790736021.644252:0:3227:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4456 MB/s 00000020:02000000:2.0:1790736022.511360:0:3275:0:(class_obd.c:846:obdclass_init()) Lustre: Build Version: 2.17.59_3_g94a7b9b 00000400:02000000:3.0:1790736023.575515:0:3290:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.105@tcp [8/256/0/180] 00008000:02000000:2.0:1790736027.041999:0:3440:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1790736073.065752:0:5242:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg305-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1790736082.572954:0:5824:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790736082.572960:0:5824:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1790736082.573143:0:5824:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000f8d260b5 00000080:02000400:0.0:1790736082.573155:0:5824:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' or install '{/usr}/sbin/mount.lustre_tgt' 00000020:01000004:0.0:1790736082.581310:0:5824:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1790736082.581327:0:5824:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1790736082.581374:0:5824:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000005ef8d28) 00000020:00000080:0.0:1790736082.581395:0:5824:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1790736082.609491:0:5824:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1790736082.610212:0:5824:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1790736082.647396:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1790736082.647438:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1790736082.647461:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1790736082.647512:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1790736082.647537:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1790736082.648935:0:5824:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1790736082.648943:0:5824:0:(osd_handler.c:1577:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790736082.648958:0:5824:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6aae200528fe5ed9 00000020:01000004:2.0:1790736082.648966:0:5824:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1790736082.648972:0:5824:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1790736082.648976:0:5824:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f8d260b5 from MGS 00000020:01000004:2.0:1790736082.648980:0:5824:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1790736082.649000:0:5824:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000004f83f76a) 00000020:00000080:2.0:1790736082.649013:0:5824:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1790736082.649127:0:5824:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f8d260b5 from MGS, refs=2 00080000:01000000:2.0:1790736082.649133:0:5824:0:(osd_handler.c:1577:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790736082.649139:0:5824:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6aae200528fe5ee7 00000100:00100000:2.0:1790736082.649244:0:5824:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1790736082.649380:0:5824:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1790736082.649386:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1790736082.651343:0:5824:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1790736082.651354:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1790736082.652054:0:5824:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790736082.652264:0:5824:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1790736082.652270:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1790736082.661262:0:5824:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1790736082.663052:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1790736082.663794:0:5824:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1790736082.663803:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1790736082.665470:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736082.665474:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736082.665476:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736082.666061:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736082.666064:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736082.666066:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736082.668059:0:5824:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1790736082.670194:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1790736082.917929:0:5824:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2799 MB/s 00000001:01000000:2.0:1790736083.167239:0:5824:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3059 MB/s 00000001:01000000:0.0:1790736083.417203:0:5824:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 363 MB/s 00000001:01000000:0.0:1790736083.670602:0:5824:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 426 MB/s 00080000:10000000:2.0:1790736083.689201:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1790736083.725464:0:5824:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1790736083.725480:0:5824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1790736083.725483:0:5824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1790736083.731763:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1790736083.732019:0:5824:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1790736083.732073:0:5824:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1790736083.732328:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1790736083.732354:0:5824:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1790736083.732692:0:5824:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790736083.732858:0:5824:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1790736083.733271:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1790736083.736388:0:5824:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1790736083.736404:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00010000:00010000:1.0:1790736083.736748:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736083.737720:0:5824:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1790736083.737964:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1790736083.749064:0:5824:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1790736083.749119:0:5824:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.105@tcp' 00000020:01000004:3.0:1790736083.749122:0:5824:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1790736083.749170:0:5824:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.105@tcp (typ=mgc) 00000020:00000080:3.0:1790736083.749194:0:5824:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.105@tcp (000000007c2af896) 00000020:00000080:3.0:1790736083.749211:0:5824:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1790736083.749345:0:5824:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a09c07a7@MGC192.168.203.105@tcp: add connection 192.168.203.105@tcp at head 00010000:00010000:3.0:1790736083.749538:0:5824:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.105@tcp-0 is initialized 00000040:01000000:3.0:1790736083.749543:0:5824:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.105@tcp ctxt 1 is initialized 00000100:00080000:0.0:1790736083.752312:0:5839:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1790736083.756641:0:5841:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1790736083.759972:0:5824:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.105@tcp (uuid 52e04a2b-4e01-44b7-985c-7db034e22389) 00000020:00000080:3.0:1790736083.760000:0:5824:0:(genops.c:1384:class_connect()) connect: client 52e04a2b-4e01-44b7-985c-7db034e22389, cookie 0x6aae200528fe5ef5 00000100:00080000:3.0:1790736083.760011:0:5824:0:(import.c:545:import_select_connection()) MGC192.168.203.105@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790736083.760022:0:5824:0:(import.c:666:import_select_connection()) MGC192.168.203.105@tcp: import 00000000a09c07a7 using connection 192.168.203.105@tcp/0@lo 00000100:00100000:3.0:1790736083.760071:0:5824:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005886d8d6 x1877722816053376/t0(0) o250->MGC192.168.203.105@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790736083.760125:0:5824:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 52e04a2b-4e01-44b7-985c-7db034e22389->MGS 00000020:01000004:3.0:1790736083.760144:0:5824:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1790736083.760148:0:5824:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1790736083.760162:0:5824:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000d8e1dd46) 00000020:00000080:3.0:1790736083.760173:0:5824:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1790736083.764250:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005886d8d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:52e04a2b-4e01-44b7-985c-7db034e22389:3305:1877722816053376:0@lo:250: 00000100:00100000:0.0:1790736083.764346:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736083.767237:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816053376 00000100:00100000:1.0:1790736083.767254:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816053376 00000100:00100000:1.0:1790736083.767307:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790736083.767314:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000cad7be08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3305:x1877722816053376:12345-0@lo:250: 00010000:00080000:1.0:1790736083.767344:0:5836:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 52e04a2b-4e01-44b7-985c-7db034e22389@0@lo t0 exp 0000000000000000 cur 155 last 0 00000020:00000080:1.0:1790736083.767378:0:5836:0:(genops.c:1384:class_connect()) connect: client 52e04a2b-4e01-44b7-985c-7db034e22389, cookie 0x6aae200528fe5f03 00000100:00080000:1.0:1790736083.768634:0:5836:0:(import.c:65:import_set_state_nolock()) 00000000efd8f50a : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790736083.770182:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000cad7be08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+5:3305:x1877722816053376:12345-0@lo:250: Request processed in 2859us (5828us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736083.770197:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790736083.770281:0:3305:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.105@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1790736083.770291:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.105@tcp: connect to target with instance 0 00000100:00080000:1.0:1790736083.770299:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.105@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1790736083.770304:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1790736083.770308:0:3305:0:(import.c:65:import_set_state_nolock()) 00000000a09c07a7 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1790736083.770311:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1790736083.770320:0:3305:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1790736083.770327:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005886d8d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:52e04a2b-4e01-44b7-985c-7db034e22389:3305:1877722816053376:0@lo:250: 00000100:00100000:3.0:1790736083.799668:0:5824:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790736083.800376:0:5824:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1790736083.800384:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1790736083.802554:0:5824:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1790736083.802566:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1790736083.813734:0:5824:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1790736083.813748:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1790736083.814856:0:5824:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790736083.815057:0:5824:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1790736083.815062:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1790736083.819815:0:5824:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1790736083.819835:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1790736083.922841:0:5824:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790736083.923068:0:5824:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1790736083.923075:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1790736083.924439:0:5824:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1790736083.924450:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1790736083.925534:0:5824:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790736083.925716:0:5824:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790736083.925721:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1790736083.926530:0:5824:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790736083.926539:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1790736083.927277:0:5824:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790736083.927539:0:5824:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790736083.927544:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1790736083.928062:0:5824:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790736083.928069:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1790736083.931899:0:5824:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790736083.932080:0:5824:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790736083.932086:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1790736083.932703:0:5824:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790736083.932710:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1790736083.994138:0:5824:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790736083.994337:0:5824:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1790736083.994343:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1790736084.002911:0:5824:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1790736084.002934:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1790736084.004676:0:5824:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1790736084.004702:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1790736084.012060:0:5824:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1790736084.012087:0:5824:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1790736084.012121:0:5824:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.105@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1790736084.012256:0:5824:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.105@tcp ctxt 0 is initialized 00000020:01000004:0.0:1790736084.012292:0:5824:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.105@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1790736084.012297:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1790736084.012298:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790736084.012300:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790736084.012301:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790736084.012302:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790736084.012304:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790736084.012305:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790736084.012307:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790736084.012308:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790736084.012309:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790736084.012314:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790736084.012315:0:5824:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790736084.012318:0:5824:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1790736084.012320:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790736084.012321:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790736084.012322:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790736084.012322:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790736084.012323:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790736084.012324:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790736084.012325:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790736084.012326:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790736084.012327:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790736084.012328:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790736084.012329:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790736084.012330:0:5824:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790736084.012367:0:5824:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1790736084.012386:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cd98705e pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:5824:1877722816053504:0@lo:253: 00000100:00100000:0.0:1790736084.012864:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736084.012977:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 000000009aa9bb7a going to sleep for 11 seconds 00000100:00100000:0.0:1790736084.019717:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816053504 00000100:00100000:0.0:1790736084.019743:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816053504 00000100:00100000:0.0:1790736084.019826:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790736084.019835:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000099039898 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+5:5824:x1877722816053504:12345-0@lo:253: 20000000:01000000:0.0:1790736084.019898:0:5838:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790736084.019902:0:5838:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1790736084.020384:0:5859:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1790736084.020557:0:5838:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1790736084.020859:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790736084.022244:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1790736084.022608:0:5838:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790736084.022613:0:5838:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1790736084.022620:0:5838:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1790736084.022623:0:5838:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1790736084.022637:0:5838:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1790736084.022863:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790736084.023153:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1790736084.023167:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1790736084.023230:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1790736084.023295:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1790736084.023335:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1790736084.024571:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1790736084.024592:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1790736084.024679:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1790736084.024690:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1790736084.024723:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1790736084.025955:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1790736084.026031:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1790736084.026118:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1790736084.026185:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1790736084.026193:0:5838:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1790736084.026209:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790736084.027604:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1790736084.027627:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1790736084.027690:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1790736084.027836:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1790736084.027907:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1790736084.027924:0:5838:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1790736084.028033:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1790736084.028042:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1790736084.028087:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1790736084.028179:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1790736084.028217:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1790736084.028228:0:5838:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1790736084.028315:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1790736084.028325:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1790736084.028358:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1790736084.028392:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1790736084.028650:0:5838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1790736084.028706:0:5838:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1790736084.028721:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1790736084.032520:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1790736084.032818:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1790736084.032846:0:5838:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.105@tcp for mdt 20000000:01000000:0.0:1790736084.032848:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.105@tcp (null) (null) (null) 00000040:00080000:0.0:1790736084.033149:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1790736084.033160:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1790736084.033192:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1790736084.033200:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.105@tcp (null) (null) 00000040:00080000:0.0:1790736084.033246:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1790736084.033257:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1790736084.033289:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1790736084.033323:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1790736084.033387:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1790736084.033391:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1790736084.033396:0:5838:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1790736084.033403:0:5838:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1790736084.035150:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:3.0:1790736084.035339:0:5838:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1790736084.045487:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1790736084.045538:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:3.0:1790736084.045615:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:3.0:1790736084.045634:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1790736084.045636:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1790736084.045646:0:5838:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1790736084.045658:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1790736084.045661:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1790736084.045689:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1790736084.045692:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1790736084.055286:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1790736084.055707:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1790736084.055767:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1790736084.055803:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1790736084.055818:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1790736084.055820:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1790736084.056664:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:0.0:1790736084.060272:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:0.0:1790736084.060325:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:0.0:1790736084.060441:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:0.0:1790736084.060459:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790736084.060461:0:5838:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:0.0:1790736084.060469:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1790736084.060489:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000060060eaf/0x6aae200528fe5f0a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736084.060515:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000060060eaf/0x6aae200528fe5f0a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736084.060525:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000060060eaf/0x6aae200528fe5f0a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736084.060531:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000060060eaf/0x6aae200528fe5f0a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736084.060539:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000060060eaf/0x6aae200528fe5f0a lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736084.060546:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000060060eaf/0x6aae200528fe5f0a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736084.060552:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000060060eaf already unused, calling callback (00000000d994fea1) 00010000:00010000:0.0:1790736084.060555:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000060060eaf/0x6aae200528fe5f0a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736084.060562:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000060060eaf/0x6aae200528fe5f0a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736084.060573:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000060060eaf/0x6aae200528fe5f0a lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736084.060580:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000060060eaf/0x6aae200528fe5f0a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736084.060586:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000060060eaf/0x6aae200528fe5f0a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790736084.060613:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1790736084.428815:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000099039898 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+5:5824:x1877722816053504:12345-0@lo:253: Request processed in 408974us (415945us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736084.428830:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790736084.429024:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cd98705e pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:5824:1877722816053504:0@lo:253: 10000000:01000000:3.0:1790736084.429040:0:5824:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1790736084.429043:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790736084.429045:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790736084.429046:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790736084.429047:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1790736084.429049:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790736084.429050:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790736084.429051:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790736084.429053:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790736084.429054:0:5824:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1790736084.429055:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790736084.429056:0:5824:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790736084.429074:0:5824:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f8d260b5 from lustre-MDT0000 10000000:01000000:3.0:1790736084.429142:0:5824:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1790736084.429146:0:5824:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1790736084.429151:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff94160837b380 10000000:01000000:3.0:1790736084.429155:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790736084.429165:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff94160837b380 from 1 10000000:01000000:3.0:1790736084.429168:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790736084.429216:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: 00000000cd12d03d/0x6aae200528fe5f11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736084.429227:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: 00000000cd12d03d/0x6aae200528fe5f11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736084.429237:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: 00000000cd12d03d/0x6aae200528fe5f11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736084.429274:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009e19ba14 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:5824:1877722816053632:0@lo:101: 00000100:00100000:3.0:1790736084.429335:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736084.429383:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ec100220 going to sleep for 11 seconds 00000100:00100000:0.0:1790736084.429537:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816053632 00000100:00100000:0.0:1790736084.429545:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816053632 00000100:00100000:0.0:1790736084.429585:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790736084.429592:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f721c12e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+5:5824:x1877722816053632:12345-0@lo:101: 00010000:00010000:0.0:1790736084.429604:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736084.429617:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000060060eaf/0x6aae200528fe5f18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe5f11 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736084.429637:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000060060eaf/0x6aae200528fe5f18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe5f11 expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736084.429646:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000060060eaf/0x6aae200528fe5f18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe5f11 expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736084.429653:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000060060eaf, rc 0) 00000100:00100000:0.0:1790736084.429682:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f721c12e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+6:5824:x1877722816053632:12345-0@lo:101: Request processed in 91us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736084.429689:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790736084.429950:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009e19ba14 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:5824:1877722816053632:0@lo:101: 00010000:00010000:3.0:1790736084.429964:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: 00000000cd12d03d/0x6aae200528fe5f11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe5f18 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736084.429973:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: 00000000cd12d03d/0x6aae200528fe5f11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe5f18 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736084.430025:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009e19ba14 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:5824:1877722816053760:0@lo:501: 00000100:00100000:3.0:1790736084.430049:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736084.430070:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ec100220 going to sleep for 11 seconds 00000100:00100000:0.0:1790736084.430176:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816053760 00000100:00100000:0.0:1790736084.430182:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816053760 00000100:00100000:0.0:1790736084.430212:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790736084.430218:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000092882810 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+6:5824:x1877722816053760:12345-0@lo:501: 00000100:00100000:0.0:1790736084.430456:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000092882810 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+6:5824:x1877722816053760:12345-0@lo:501: Request processed in 237us (405us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790736084.430469:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790736084.430580:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009e19ba14 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:5824:1877722816053760:0@lo:501: 10000000:01000000:3.0:1790736084.430606:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1790736084.430623:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: 00000000cd12d03d/0x6aae200528fe5f11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe5f18 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736084.430632:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: 00000000cd12d03d/0x6aae200528fe5f11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe5f18 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790736084.430642:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff941604c0d800 10000000:01000000:3.0:1790736084.430647:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790736084.430652:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff941604c0d800 10000000:01000000:3.0:1790736084.430654:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1790736084.430657:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff941604c0d800 from 1 10000000:01000000:3.0:1790736084.430665:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1790736084.430686:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: 0000000035430bfc/0x6aae200528fe5f1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736084.430693:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: 0000000035430bfc/0x6aae200528fe5f1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736084.430701:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: 0000000035430bfc/0x6aae200528fe5f1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736084.430712:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009e19ba14 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:5824:1877722816053888:0@lo:101: 00000100:00100000:3.0:1790736084.430747:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736084.430774:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ec100220 going to sleep for 11 seconds 00000100:00100000:0.0:1790736084.430934:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816053888 00000100:00100000:0.0:1790736084.430939:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816053888 00000100:00100000:0.0:1790736084.430970:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790736084.430978:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000003ea6f97f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+6:5824:x1877722816053888:12345-0@lo:101: 00010000:00010000:0.0:1790736084.430988:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736084.431000:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ee764255/0x6aae200528fe5f26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe5f1f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736084.431014:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ee764255/0x6aae200528fe5f26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe5f1f expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736084.431021:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ee764255/0x6aae200528fe5f26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe5f1f expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736084.431027:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ee764255, rc 0) 00000100:00100000:0.0:1790736084.431064:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000003ea6f97f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+7:5824:x1877722816053888:12345-0@lo:101: Request processed in 88us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736084.431070:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790736084.431160:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009e19ba14 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:5824:1877722816053888:0@lo:101: 00010000:00010000:1.0:1790736084.431171:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: 0000000035430bfc/0x6aae200528fe5f1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe5f26 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736084.431178:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: 0000000035430bfc/0x6aae200528fe5f1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe5f26 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790736084.431189:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1790736084.431202:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: 0000000035430bfc/0x6aae200528fe5f1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe5f26 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736084.431208:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: 0000000035430bfc/0x6aae200528fe5f1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe5f26 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790736084.431213:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1790736084.431217:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790736084.431222:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff941604c0d800 10000000:01000000:1.0:1790736084.431224:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1790736084.431227:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1790736084.431229:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1790736084.431256:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: 00000000dd6fb098/0x6aae200528fe5f2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736084.431262:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: 00000000dd6fb098/0x6aae200528fe5f2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736084.431281:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: 00000000dd6fb098/0x6aae200528fe5f2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736084.431291:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e270747e pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:5824:1877722816054016:0@lo:101: 00000100:00100000:1.0:1790736084.431317:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736084.431336:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 00000000894987fd going to sleep for 11 seconds 00000100:00100000:1.0:1790736084.431350:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816054016 00000100:00100000:1.0:1790736084.431354:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816054016 00000100:00100000:1.0:1790736084.431376:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790736084.431381:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000001d5d097f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+7:5824:x1877722816054016:12345-0@lo:101: 00010000:00010000:1.0:1790736084.431388:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736084.431396:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c44bc229/0x6aae200528fe5f34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe5f2d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736084.431410:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c44bc229/0x6aae200528fe5f34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe5f2d expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736084.431417:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c44bc229/0x6aae200528fe5f34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe5f2d expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736084.431424:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c44bc229, rc 0) 00000100:00100000:1.0:1790736084.431450:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000001d5d097f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+8:5824:x1877722816054016:12345-0@lo:101: Request processed in 69us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736084.431456:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790736084.431485:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e270747e pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:5824:1877722816054016:0@lo:101: 00010000:00010000:1.0:1790736084.431494:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: 00000000dd6fb098/0x6aae200528fe5f2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe5f34 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736084.431512:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: 00000000dd6fb098/0x6aae200528fe5f2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe5f34 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736084.431550:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e270747e pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:5824:1877722816054144:0@lo:501: 00000100:00100000:1.0:1790736084.431573:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736084.431584:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 00000000894987fd going to sleep for 11 seconds 00000100:00100000:1.0:1790736084.431596:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816054144 00000100:00100000:1.0:1790736084.431600:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816054144 00000100:00100000:1.0:1790736084.431620:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790736084.431625:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000087a80218 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+8:5824:x1877722816054144:12345-0@lo:501: 00000100:00100000:1.0:1790736084.431831:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000087a80218 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+9:5824:x1877722816054144:12345-0@lo:501: Request processed in 205us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736084.431838:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790736084.431884:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e270747e pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:5824:1877722816054144:0@lo:501: 00000100:00100000:1.0:1790736084.431910:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e270747e pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:5824:1877722816054272:0@lo:503: 00000100:00100000:1.0:1790736084.431965:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736084.431978:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 00000000894987fd going to sleep for 11 seconds 00000100:00100000:1.0:1790736084.432054:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816054272 00000100:00100000:1.0:1790736084.432059:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816054272 00000100:00100000:1.0:1790736084.432078:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790736084.432083:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000008f726991 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+9:5824:x1877722816054272:12345-0@lo:503: 00000100:00100000:1.0:1790736084.432246:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000008f726991 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+9:5824:x1877722816054272:12345-0@lo:503: Request processed in 162us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736084.432252:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790736084.432287:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e270747e pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:5824:1877722816054272:0@lo:503: 00000100:00100000:0.0:1790736084.433212:0:5868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e4952317 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:5868:1877722816054400:0@lo:502: 00000100:00100000:1.0:1790736084.433339:0:5868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736084.433437:0:5868:0:(client.c:2716:ptlrpc_set_wait()) set 000000002c72ad5a going to sleep for 11 seconds 00000100:00100000:2.0:1790736084.433472:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816054400 00000100:00100000:2.0:1790736084.433477:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816054400 00000100:00100000:2.0:1790736084.433533:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790736084.433539:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000001412971c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+9:5868:x1877722816054400:12345-0@lo:502: 00000100:00100000:2.0:1790736084.433740:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000001412971c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+9:5868:x1877722816054400:12345-0@lo:502: Request processed in 202us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736084.433747:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790736084.433817:0:5868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e4952317 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:5868:1877722816054400:0@lo:502: 00000020:01000000:3.0:1790736084.433840:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790736084.433850:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790736084.433852:0:5868:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790736084.433857:0:5868:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1790736084.433860:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790736084.433885:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000c2e451bb) 00000020:00000080:3.0:1790736084.433904:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1790736084.433910:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1790736084.433986:0:5868:0:(osd_handler.c:1577:osd_obd_connect()) connect #2 00000020:00000080:3.0:1790736084.433993:0:5868:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6aae200528fe5f42 00000020:00000080:3.0:1790736084.434252:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1790736084.434257:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790736084.434260:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790736084.434262:0:5868:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790736084.434265:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790736084.434268:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790736084.434269:0:5868:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1790736084.434278:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790736084.434286:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000e31b7871) 00000020:00000080:3.0:1790736084.434295:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1790736084.434298:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1790736084.434301:0:5868:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1790736084.434303:0:5868:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1790736084.434309:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790736084.434350:0:5868:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f8d260b5 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1790736084.434368:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000002a73a5ac) 00000020:00000080:3.0:1790736084.434377:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1790736084.434444:0:5868:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1790736084.434450:0:5868:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6aae200528fe5f57 00000020:00000080:3.0:1790736084.434565:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1790736084.434572:0:5868:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1790736084.434577:0:5868:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x6aae200528fe5f5e 00080000:01000000:3.0:1790736084.434582:0:5868:0:(osd_handler.c:1577:osd_obd_connect()) connect #3 00000020:00000080:3.0:1790736084.434585:0:5868:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6aae200528fe5f65 00080000:10000000:3.0:1790736084.434962:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1790736084.435222:0:5868:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1790736084.439634:0:5868:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1790736084.559681:0:5868:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1790736084.560563:0:5868:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1790736084.564609:0:5868:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1790736084.564915:0:5868:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1790736084.608278:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000f69e149d) 00000020:00000080:2.0:1790736084.608304:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1790736084.608388:0:5868:0:(osd_handler.c:1577:osd_obd_connect()) connect #4 00000020:00000080:2.0:1790736084.608395:0:5868:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6aae200528fe5f73 00000020:00000080:1.0:1790736084.620087:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1790736084.621640:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1790736084.751297:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00010000:00010000:0.0:1790736084.766420:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1790736084.862252:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1790736084.932835:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1790736085.008781:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1790736085.062752:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1790736085.121942:0:5868:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x6aae200528fe5f7a 00000020:00000080:2.0:1790736085.123026:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1790736085.123038:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790736085.123045:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790736085.123047:0:5868:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1790736085.123051:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790736085.123057:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790736085.123058:0:5868:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1790736085.123063:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1790736085.123247:0:5868:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1790736085.123268:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790736085.123272:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790736085.123274:0:5868:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1790736085.123276:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790736085.123278:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790736085.123280:0:5868:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790736085.123283:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790736085.123285:0:5868:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1790736085.123341:0:5868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b15ce943 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:5868:1877722816054528:0@lo:502: 00000100:00100000:2.0:1790736085.123453:0:5868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736085.123758:0:5868:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c4bad76c going to sleep for 11 seconds 00000100:00100000:3.0:1790736085.124845:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816054528 00000100:00100000:3.0:1790736085.124856:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816054528 00000100:00100000:3.0:1790736085.125340:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790736085.125351:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000000b31e188 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+9:5868:x1877722816054528:12345-0@lo:502: 00000100:00100000:3.0:1790736085.125799:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000000b31e188 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+9:5868:x1877722816054528:12345-0@lo:502: Request processed in 450us (2346us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736085.125814:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790736085.126195:0:5868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b15ce943 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:5868:1877722816054528:0@lo:502: 00000020:01000000:2.0:1790736085.126231:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790736085.126238:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790736085.126240:0:5868:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790736085.126245:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1790736085.126487:0:5824:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1790736085.126505:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1790736085.126527:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: 00000000dd6fb098/0x6aae200528fe5f2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe5f34 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736085.126536:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: 00000000dd6fb098/0x6aae200528fe5f2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe5f34 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790736085.126555:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff941604c0d800 from 1 10000000:01000000:0.0:1790736085.126557:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790736085.126586:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: 0000000053ccf31f/0x6aae200528fe5f81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736085.126592:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: 0000000053ccf31f/0x6aae200528fe5f81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736085.126600:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: 0000000053ccf31f/0x6aae200528fe5f81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736085.126617:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d9c3248 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:5824:1877722816054656:0@lo:101: 00000100:00100000:0.0:1790736085.126692:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736085.129580:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 00000000894987fd going to sleep for 11 seconds 00000100:00100000:1.0:1790736085.129676:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816054656 00000100:00100000:1.0:1790736085.129686:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816054656 00000100:00100000:1.0:1790736085.129740:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790736085.129758:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000eb490911 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+9:5824:x1877722816054656:12345-0@lo:101: 00010000:00010000:1.0:1790736085.129772:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736085.129788:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cb6323af/0x6aae200528fe5f88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe5f81 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736085.129814:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cb6323af/0x6aae200528fe5f88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe5f81 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736085.129824:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cb6323af/0x6aae200528fe5f88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe5f81 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736085.129831:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cb6323af, rc 0) 00000100:00100000:1.0:1790736085.130577:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000eb490911 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+10:5824:x1877722816054656:12345-0@lo:101: Request processed in 819us (3883us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736085.130586:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790736085.131418:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d9c3248 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:5824:1877722816054656:0@lo:101: 00010000:00010000:0.0:1790736085.131441:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: 0000000053ccf31f/0x6aae200528fe5f81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe5f88 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736085.131452:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: 0000000053ccf31f/0x6aae200528fe5f81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe5f88 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736085.132401:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d9c3248 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:5824:1877722816054784:0@lo:256: 00000100:00100000:0.0:1790736085.132470:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736085.132502:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 00000000894987fd going to sleep for 11 seconds 00000100:00100000:3.0:1790736085.132592:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816054784 00000100:00100000:3.0:1790736085.132599:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816054784 00000100:00100000:0.0:1790736085.133038:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790736085.133047:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f035d5fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+10:5824:x1877722816054784:12345-0@lo:256: 20000000:01000000:0.0:1790736085.133068:0:5838:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1790736085.133080:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1790736085.133185:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f035d5fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+10:5824:x1877722816054784:12345-0@lo:256: Request processed in 139us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736085.133192:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790736085.133333:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d9c3248 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:5824:1877722816054784:0@lo:256: 10000000:01000000:3.0:1790736085.134140:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790736085.134157:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: 0000000053ccf31f/0x6aae200528fe5f81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe5f88 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736085.134167:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: 0000000053ccf31f/0x6aae200528fe5f81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe5f88 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790736085.134174:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff941604c0d800 from 1 10000000:01000000:3.0:1790736085.134178:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790736085.134206:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: 0000000057fff019/0x6aae200528fe5f8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736085.134213:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: 0000000057fff019/0x6aae200528fe5f8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736085.134222:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: 0000000057fff019/0x6aae200528fe5f8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736085.134237:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000100eadb1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:5824:1877722816054912:0@lo:101: 00000100:00100000:3.0:1790736085.134277:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736085.134367:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 000000005a3d89ff going to sleep for 11 seconds 00000100:00100000:2.0:1790736085.136584:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816054912 00000100:00100000:2.0:1790736085.136599:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816054912 00000100:00100000:1.0:1790736085.137031:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790736085.137331:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f1fe20d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+10:5824:x1877722816054912:12345-0@lo:101: 00010000:00010000:0.0:1790736085.137350:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736085.137368:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000470935ae/0x6aae200528fe5f96 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe5f8f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736085.137394:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000470935ae/0x6aae200528fe5f96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe5f8f expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736085.137405:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000470935ae/0x6aae200528fe5f96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe5f8f expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736085.137413:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000470935ae, rc 0) 00000100:00100000:0.0:1790736085.137529:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f1fe20d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+11:5824:x1877722816054912:12345-0@lo:101: Request processed in 489us (3252us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736085.137536:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790736085.137638:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000100eadb1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:5824:1877722816054912:0@lo:101: 00010000:00010000:2.0:1790736085.137656:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: 0000000057fff019/0x6aae200528fe5f8f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe5f96 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736085.137676:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: 0000000057fff019/0x6aae200528fe5f8f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe5f96 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736085.137843:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b15ce943 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:5824:1877722816055040:0@lo:501: 00000100:00100000:2.0:1790736085.137947:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736085.138069:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c4bad76c going to sleep for 11 seconds 00000100:00100000:1.0:1790736085.138347:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816055040 00000100:00100000:1.0:1790736085.138354:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816055040 00000100:00100000:1.0:1790736085.138429:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790736085.138436:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000002c07dbad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+11:5824:x1877722816055040:12345-0@lo:501: 00000100:00100000:1.0:1790736085.139190:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000002c07dbad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+11:5824:x1877722816055040:12345-0@lo:501: Request processed in 752us (1241us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736085.139208:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790736085.139447:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b15ce943 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:5824:1877722816055040:0@lo:501: 00000100:00100000:0.0:1790736085.139485:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000553187f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:5824:1877722816055168:0@lo:503: 00000100:00100000:0.0:1790736085.139526:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736085.139589:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 00000000894987fd going to sleep for 11 seconds 00000100:00100000:1.0:1790736085.139626:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816055168 00000100:00100000:1.0:1790736085.139631:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816055168 00000100:00100000:1.0:1790736085.139665:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790736085.139671:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000006157f298 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+11:5824:x1877722816055168:12345-0@lo:503: 00000040:00080000:1.0:1790736085.139707:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790736085.139918:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000006157f298 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+11:5824:x1877722816055168:12345-0@lo:503: Request processed in 248us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736085.139926:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790736085.140442:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000553187f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:5824:1877722816055168:0@lo:503: 00000040:00080000:2.0:1790736085.141700:0:5872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1790736085.142419:0:5824:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1790736085.142441:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790736085.142492:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: 0000000057fff019/0x6aae200528fe5f8f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe5f96 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736085.142518:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: 0000000057fff019/0x6aae200528fe5f8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe5f96 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790736085.142577:0:5824:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790736085.142580:0:5824:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff941604c0d800 10000000:01000000:0.0:1790736085.142584:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff941604c0d800 10000000:01000000:0.0:1790736085.142588:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790736085.142594:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff941604c0d800 from 1 10000000:01000000:0.0:1790736085.142597:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790736085.142626:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: 000000004fac2004/0x6aae200528fe5f9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736085.142634:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: 000000004fac2004/0x6aae200528fe5f9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736085.142642:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: 000000004fac2004/0x6aae200528fe5f9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736085.142665:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000553187f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:5824:1877722816055296:0@lo:101: 00000100:00100000:0.0:1790736085.142740:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736085.142782:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 00000000894987fd going to sleep for 11 seconds 00000100:00100000:1.0:1790736085.142837:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816055296 00000100:00100000:1.0:1790736085.142844:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816055296 00000100:00100000:1.0:1790736085.142902:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790736085.142913:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000adeb5c82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+11:5824:x1877722816055296:12345-0@lo:101: 00010000:00010000:1.0:1790736085.142926:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736085.142937:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dddb5e94/0x6aae200528fe5fa4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe5f9d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736085.142958:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dddb5e94/0x6aae200528fe5fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe5f9d expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736085.142967:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dddb5e94/0x6aae200528fe5fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe5f9d expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736085.142974:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dddb5e94, rc 0) 00000100:00100000:1.0:1790736085.143016:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000adeb5c82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+12:5824:x1877722816055296:12345-0@lo:101: Request processed in 107us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736085.143022:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790736085.143406:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000553187f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:5824:1877722816055296:0@lo:101: 00010000:00010000:0.0:1790736085.143421:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: 000000004fac2004/0x6aae200528fe5f9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe5fa4 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736085.143429:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: 000000004fac2004/0x6aae200528fe5f9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe5fa4 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736085.143488:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000553187f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:5824:1877722816055424:0@lo:501: 00000100:00100000:0.0:1790736085.143514:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736085.143543:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 00000000894987fd going to sleep for 11 seconds 00000100:00100000:3.0:1790736085.143597:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816055424 00000100:00100000:3.0:1790736085.143603:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816055424 00000100:00100000:3.0:1790736085.143634:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790736085.143641:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000120e09a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+12:5824:x1877722816055424:12345-0@lo:501: 00000100:00100000:3.0:1790736085.143911:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000120e09a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+12:5824:x1877722816055424:12345-0@lo:501: Request processed in 270us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736085.143918:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790736085.144041:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000553187f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:5824:1877722816055424:0@lo:501: 00000100:00100000:0.0:1790736085.144068:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000553187f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:5824:1877722816055552:0@lo:503: 00000100:00100000:0.0:1790736085.144129:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736085.144148:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 00000000894987fd going to sleep for 11 seconds 00000100:00100000:1.0:1790736085.144257:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816055552 00000100:00100000:1.0:1790736085.144267:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816055552 00000100:00100000:1.0:1790736085.144299:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790736085.144305:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000006c279685 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+12:5824:x1877722816055552:12345-0@lo:503: 00000100:00100000:1.0:1790736085.144571:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000006c279685 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+12:5824:x1877722816055552:12345-0@lo:503: Request processed in 267us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736085.144578:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790736085.144659:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000553187f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:5824:1877722816055552:0@lo:503: 00000100:00100000:0.0:1790736085.145178:0:5873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000553187f4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:5873:1877722816055680:0@lo:502: 00000100:00100000:0.0:1790736085.145217:0:5873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736085.145244:0:5873:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a8bfe925 going to sleep for 11 seconds 00000100:00100000:1.0:1790736085.145300:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816055680 00000100:00100000:1.0:1790736085.145305:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816055680 00000100:00100000:1.0:1790736085.145336:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790736085.145341:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000009cf3cbb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+12:5873:x1877722816055680:12345-0@lo:502: 00000100:00100000:1.0:1790736085.145547:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000009cf3cbb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+12:5873:x1877722816055680:12345-0@lo:502: Request processed in 206us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736085.145553:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790736085.145650:0:5873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000553187f4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:5873:1877722816055680:0@lo:502: 00000020:01000004:0.0:1790736085.145706:0:5873:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1790736085.145722:0:5873:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000634500b7) 00000020:00000080:0.0:1790736085.145739:0:5873:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1790736085.145815:0:5873:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f8d260b5 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1790736085.145820:0:5873:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000f8d260b5 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1790736085.145822:0:5873:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000f8d260b5 4 00010000:00080000:0.0:1790736085.145847:0:5873:0:(ldlm_lib.c:102:import_set_conn()) imp 000000009685be5d@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.105@tcp at head 00010000:00010000:0.0:1790736085.147591:0:5873:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1790736085.147802:0:5873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1790736085.147838:0:5873:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790736085.147849:0:5873:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x6aae200528fe5fb2 00000100:00080000:0.0:1790736085.147870:0:5873:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790736085.147880:0:5873:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000009685be5d using connection 192.168.203.105@tcp/0@lo 00000100:00100000:0.0:1790736085.147919:0:5873:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000553187f4 x1877722816055808/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790736085.147966:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000553187f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877722816055808:0@lo:38: 00000100:00100000:0.0:1790736085.148030:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736085.148121:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816055808 00000100:00100000:0.0:1790736085.148128:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816055808 00000100:00100000:0.0:1790736085.148159:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790736085.148165:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b23540ee pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1877722816055808:12345-0@lo:38: 00000100:00100000:0.0:1790736085.148212:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b23540ee pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1877722816055808:12345-0@lo:38: Request processed in 47us (182us total) trans 0 rc -11/-11 00000100:00100000:0.0:1790736085.148218:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790736085.148254:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790736085.148260:0:3305:0:(import.c:65:import_set_state_nolock()) 000000009685be5d lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790736085.148274:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1790736085.148277:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000553187f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877722816055808:0@lo:38: 00000100:00080000:0.0:1790736085.148305:0:5873:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1790736085.158117:0:5873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000553187f4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:5873:1877722816055936:0@lo:502: 00000100:00100000:0.0:1790736085.158206:0:5873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736085.158257:0:5873:0:(client.c:2716:ptlrpc_set_wait()) set 000000007d61511d going to sleep for 11 seconds 00000100:00100000:2.0:1790736085.158990:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816055936 00000100:00100000:2.0:1790736085.159000:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816055936 00000100:00100000:2.0:1790736085.159041:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790736085.159048:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000ecafb61a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+12:5873:x1877722816055936:12345-0@lo:502: 00000100:00100000:2.0:1790736085.159290:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000ecafb61a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+12:5873:x1877722816055936:12345-0@lo:502: Request processed in 242us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736085.159298:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790736085.159402:0:5873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000553187f4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:5873:1877722816055936:0@lo:502: 00000040:00080000:0.0:1790736085.159430:0:5873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1790736085.160349:0:5824:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1790736085.160369:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790736085.160389:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: 000000004fac2004/0x6aae200528fe5f9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe5fa4 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736085.160401:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: 000000004fac2004/0x6aae200528fe5f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe5fa4 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790736085.160447:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790736085.160450:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790736085.160451:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790736085.160452:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790736085.160454:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790736085.160455:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790736085.160461:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790736085.160462:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790736085.160464:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790736085.160465:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790736085.160466:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790736085.160467:0:5824:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790736085.160470:0:5824:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1790736085.160472:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790736085.160473:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790736085.160474:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790736085.160475:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790736085.160476:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790736085.160477:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790736085.160478:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790736085.160479:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790736085.160480:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790736085.160480:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790736085.160481:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790736085.160482:0:5824:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790736085.160499:0:5824:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1790736085.160512:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000010320451 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:5824:1877722816056064:0@lo:253: 00000100:00100000:2.0:1790736085.160562:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736085.160598:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c4bad76c going to sleep for 11 seconds 00000100:00100000:1.0:1790736085.160647:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816056064 00000100:00100000:1.0:1790736085.160653:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816056064 00000100:00100000:1.0:1790736085.160694:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790736085.160701:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000004e6de8e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+12:5824:x1877722816056064:12345-0@lo:253: 20000000:01000000:1.0:1790736085.160731:0:5836:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1790736085.160847:0:5836:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1790736085.198629:0:5836:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1790736085.198648:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1790736085.198677:0:5859:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790736085.198682:0:5859:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790736085.198703:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e701ba09/0x6aae200528fe5fb9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736085.198830:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000cb6323af/0x6aae200528fe5f88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe5f81 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736085.198839:0:5859:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e701ba09/0x6aae200528fe5fb9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736085.199386:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000cb6323af/0x6aae200528fe5f88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6aae200528fe5f81 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736085.199429:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000cb6323af/0x6aae200528fe5f88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6aae200528fe5f81 expref: 12 pid: 5836 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736085.199445:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004c9a1ffc pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1877722816056192:0@lo:104: 00000100:00100000:2.0:1790736085.199513:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736085.199581:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f1fbc280 going to sleep for 11 seconds 00000100:00100000:3.0:1790736085.200199:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816056192 00000100:00100000:3.0:1790736085.200210:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816056192 00000100:00100000:3.0:1790736085.200260:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790736085.200269:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000692e627c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:52e04a2b-4e01-44b7-985c-7db034e22389+3:5859:x1877722816056192:12345-0@lo:104: 00010000:00010000:3.0:1790736085.200282:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: 0000000053ccf31f/0x6aae200528fe5f81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe5f88 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736085.200703:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790736085.200709:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000692e627c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:52e04a2b-4e01-44b7-985c-7db034e22389+3:5859:x1877722816056192:12345-0@lo:104: Request processed in 442us (1197us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736085.200723:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1790736085.200996:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790736085.201003:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: 0000000053ccf31f/0x6aae200528fe5f81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe5f88 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736085.201010:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000053ccf31f already unused, calling callback (000000004efe8364) 10000000:00010000:2.0:1790736085.201013:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: 0000000053ccf31f/0x6aae200528fe5f81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6aae200528fe5f88 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736085.201021:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: 0000000053ccf31f/0x6aae200528fe5f81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6aae200528fe5f88 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790736085.201027:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: 0000000053ccf31f/0x6aae200528fe5f81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6aae200528fe5f88 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790736085.201033:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790736085.201073:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: 0000000053ccf31f/0x6aae200528fe5f81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe5f88 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736085.201080:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790736085.201119:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: 0000000053ccf31f/0x6aae200528fe5f81 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe5f88 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736085.201126:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: 0000000053ccf31f/0x6aae200528fe5f81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe5f88 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736085.201157:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736085.201159:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736085.201160:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790736085.201247:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790736085.201258:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec36689d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816056320:0@lo:103: 00000100:00100000:2.0:1790736085.201293:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736085.201380:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816056320 00000100:00100000:3.0:1790736085.201386:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816056320 00010000:00010000:3.0:1790736085.201403:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000cb6323af/0x6aae200528fe5f88 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe5f81 expref: 13 pid: 5836 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736085.201438:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790736085.201444:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000004e116644 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52e04a2b-4e01-44b7-985c-7db034e22389+13:3306:x1877722816056320:12345-0@lo:103: 00010000:00010000:3.0:1790736085.201454:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790736085.201457:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000cb6323af/0x6aae200528fe5f88 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe5f81 expref: 13 pid: 5836 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736085.201467:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000cb6323af/0x6aae200528fe5f88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6aae200528fe5f81 expref: 13 pid: 5836 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736085.201486:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e701ba09/0x6aae200528fe5fb9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736085.201493:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e701ba09/0x6aae200528fe5fb9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790736085.201505:0:5828:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002824020s 00010000:00010000:3.0:1790736085.201508:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e701ba09/0x6aae200528fe5fb9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736085.201514:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e701ba09/0x6aae200528fe5fb9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736085.201519:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e701ba09/0x6aae200528fe5fb9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736085.201524:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e701ba09/0x6aae200528fe5fb9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736085.201529:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e701ba09 already unused, calling callback (00000000d994fea1) 00010000:00010000:3.0:1790736085.201532:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e701ba09/0x6aae200528fe5fb9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736085.201539:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e701ba09/0x6aae200528fe5fb9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736085.201546:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e701ba09/0x6aae200528fe5fb9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736085.201555:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790736085.201589:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000004e116644 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52e04a2b-4e01-44b7-985c-7db034e22389+13:3306:x1877722816056320:12345-0@lo:103: Request processed in 145us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736085.201602:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790736085.201639:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec36689d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816056320:0@lo:103: 00010000:00010000:0.0:1790736085.202133:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cb6323af/0x6aae200528fe5f88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6aae200528fe5f81 expref: 12 pid: 5836 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736085.202145:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004c9a1ffc pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1877722816056192:0@lo:104: 00010000:00010000:0.0:1790736085.202159:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e701ba09/0x6aae200528fe5fb9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736085.202174:0:5859:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e701ba09/0x6aae200528fe5fb9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736085.202180:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e701ba09/0x6aae200528fe5fb9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736085.202186:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e701ba09/0x6aae200528fe5fb9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736085.216607:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000004e6de8e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+11:5824:x1877722816056064:12345-0@lo:253: Request processed in 55900us (56039us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736085.216622:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790736085.216763:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000010320451 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:5824:1877722816056064:0@lo:253: 10000000:01000000:1.0:1790736085.216778:0:5824:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1790736085.216781:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790736085.216782:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790736085.216784:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790736085.216785:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790736085.216786:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790736085.216787:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790736085.216789:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790736085.216790:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790736085.216791:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790736085.216805:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790736085.216806:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790736085.216808:0:5824:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790736085.216821:0:5824:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1790736085.225512:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1790736085.226539:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1790736085.227419:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1790736085.227611:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1790736085.228352:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1790736085.228605:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1790736085.230526:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1790736085.230702:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1790736085.231419:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1790736085.231585:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1790736085.232084:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1790736085.232397:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1790736085.329062:0:5824:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1790736085.374049:0:5824:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1790736085.374326:0:5878:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1790736085.374331:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1790736085.374483:0:5879:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1790736085.379073:0:5824:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1790736085.379368:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1790736085.380328:0:5824:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1790736085.380338:0:5824:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1790736085.380524:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790736085.382607:0:5824:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1790736085.384644:0:5824:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1790736085.384711:0:5824:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1790736085.388396:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1790736085.389767:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1790736085.393178:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1790736085.393327:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1790736085.393466:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1790736085.393621:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1790736085.393746:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1790736085.394663:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1790736085.394843:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1790736085.395315:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1790736085.395451:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1790736085.395582:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1790736085.396679:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1790736085.398282:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1790736085.398436:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1790736085.398579:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1790736085.398743:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1790736085.400034:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1790736085.402700:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1790736085.403389:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1790736085.403524:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1790736085.403653:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1790736085.406380:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1790736085.406575:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1790736085.407124:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1790736085.407324:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1790736085.407472:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1790736085.407628:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1790736085.407813:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1790736085.408476:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1790736085.408627:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1790736085.408833:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1790736085.409296:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1790736085.409459:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1790736085.409669:0:5824:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1790736085.467813:0:5879:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1790736085.589220:0:5824:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1790736085.589260:0:5824:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb2d3c1c93988 00100000:10000000:2.0:1790736085.589269:0:5824:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1790736085.590853:0:5824:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790736085.590877:0:5824:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.105@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790736085.590893:0:5824:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1790736085.590981:0:5824:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1790736085.689031:0:5879:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1790736085.690611:0:5879:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1790736085.690618:0:5879:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1790736085.788314:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736086.805372:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736087.830755:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736088.853367:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736089.883255:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790736090.269855:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1790736090.269865:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1790736090.269868:0:36:0:(import.c:65:import_set_state_nolock()) 000000009685be5d lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790736090.269893:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000009685be5d using connection 192.168.203.105@tcp/0@lo 00000100:00100000:3.0:1790736090.269914:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000082f4e480 x1877722816056576/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790736090.270181:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a9a724da pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816056448:0@lo:400: 00000100:00100000:1.0:1790736090.270245:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736090.271545:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816056448 00000100:00100000:3.0:1790736090.271558:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816056448 00000100:00100000:3.0:1790736090.271613:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790736090.271621:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000abd85b72 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+11:3308:x1877722816056448:12345-0@lo:400: 00000100:00100000:3.0:1790736090.271696:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000abd85b72 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+11:3308:x1877722816056448:12345-0@lo:400: Request processed in 76us (1452us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736090.271703:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790736090.271788:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a9a724da pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816056448:0@lo:400: 00000100:00100000:0.0:1790736090.272364:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000082f4e480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877722816056576:0@lo:38: 00000100:00100000:0.0:1790736090.272410:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736090.275136:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816056576 00000100:00100000:3.0:1790736090.275157:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816056576 00000100:00100000:3.0:1790736090.275214:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790736090.275222:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000553187f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1877722816056576:12345-0@lo:38: 00010000:00080000:3.0:1790736090.275253:0:5845:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 162 last 0 00000020:00000080:3.0:1790736090.282959:0:5845:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x6aae200528fe5fc0 00000004:00100000:3.0:1790736090.283037:0:5845:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790736090.283206:0:5845:0:(import.c:65:import_set_state_nolock()) 0000000042a328d3 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790736090.283320:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000553187f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877722816056576:12345-0@lo:38: Request processed in 8096us (10908us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736090.283330:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790736090.283579:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000082f4e480 x1877722816056576/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790736100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790736090.283596:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1790736090.283602:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1790736090.283607:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790736090.283609:0:3305:0:(import.c:65:import_set_state_nolock()) 000000009685be5d lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790736090.283615:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000082f4e480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877722816056576:0@lo:38: 00000001:02000400:1.0:1790736090.355666:0:6121:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg305-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790736090.902271:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736091.927918:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736092.950119:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790736093.333267:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790736093.333275:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff941604c0d800 from 3 10000000:01000000:3.0:1790736093.333279:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790736093.333323:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: 0000000074f72480/0x6aae200528fe5fc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736093.333335:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: 0000000074f72480/0x6aae200528fe5fc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736093.333346:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: 0000000074f72480/0x6aae200528fe5fc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736093.333369:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000764e5975 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816056704:0@lo:101: 00000100:00100000:3.0:1790736093.333438:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736093.333509:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e353a1ca going to sleep for 11 seconds 00000100:00100000:2.0:1790736093.334450:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816056704 00000100:00100000:2.0:1790736093.334461:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816056704 00000100:00100000:2.0:1790736093.334527:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790736093.334535:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d55e56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+11:5841:x1877722816056704:12345-0@lo:101: 00010000:00010000:2.0:1790736093.334550:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736093.334565:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000df52e07d/0x6aae200528fe5fce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe5fc7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736093.334588:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000df52e07d/0x6aae200528fe5fce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe5fc7 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736093.334597:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000df52e07d/0x6aae200528fe5fce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe5fc7 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736093.334605:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000df52e07d, rc 0) 00000100:00100000:2.0:1790736093.334668:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d55e56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+12:5841:x1877722816056704:12345-0@lo:101: Request processed in 134us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736093.334675:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790736093.334797:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000764e5975 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816056704:0@lo:101: 00010000:00010000:0.0:1790736093.334820:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: 0000000074f72480/0x6aae200528fe5fc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe5fce expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736093.334829:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: 0000000074f72480/0x6aae200528fe5fc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe5fce expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736093.334890:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a0d9ac84 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816056832:0@lo:256: 00000100:00100000:0.0:1790736093.334923:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736093.334957:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 000000002a255482 going to sleep for 11 seconds 00000100:00100000:1.0:1790736093.334996:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816056832 00000100:00100000:1.0:1790736093.335002:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816056832 00000100:00100000:1.0:1790736093.335038:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790736093.335044:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000befd4e0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+12:5841:x1877722816056832:12345-0@lo:256: 20000000:01000000:1.0:1790736093.335065:0:5837:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790736093.335079:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790736093.335082:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1790736093.335191:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000befd4e0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+12:5841:x1877722816056832:12345-0@lo:256: Request processed in 148us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736093.335199:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790736093.335286:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a0d9ac84 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816056832:0@lo:256: 10000000:01000000:0.0:1790736093.335325:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790736093.335331:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: 0000000074f72480/0x6aae200528fe5fc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe5fce expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736093.335339:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: 0000000074f72480/0x6aae200528fe5fc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe5fce expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736093.973216:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736094.998075:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736095.381346:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000003a2eb7b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877722816057088:0@lo:400: 00000100:00100000:1.0:1790736095.381428:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736095.383136:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790736095.383159:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e270747e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816056960:0@lo:400: 00000100:00100000:3.0:1790736095.383233:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736095.383504:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816057088 00000100:00100000:0.0:1790736095.383514:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816057088 00000100:00100000:0.0:1790736095.383568:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790736095.383577:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000499c1430 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877722816057088:12345-0@lo:400: 00000100:00100000:0.0:1790736095.383635:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000499c1430 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877722816057088:12345-0@lo:400: Request processed in 59us (2207us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736095.383643:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1790736095.383682:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000003a2eb7b x1877722816057088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790736111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790736095.383709:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000003a2eb7b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877722816057088:0@lo:400: 00000100:00100000:1.0:1790736095.383811:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816056960 00000100:00100000:1.0:1790736095.383816:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816056960 00000100:00100000:1.0:1790736095.383842:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790736095.383848:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c2e37115 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+12:3308:x1877722816056960:12345-0@lo:400: 00000100:00100000:1.0:1790736095.383885:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c2e37115 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+12:3308:x1877722816056960:12345-0@lo:400: Request processed in 37us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736095.383896:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790736095.384403:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e270747e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816056960:0@lo:400: 00000020:00000080:2.0:1790736095.707743:0:6323:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe3bdd6f10 20000000:00000080:2.0:1790736095.707758:0:6323:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9416063ccc00 uarg=0000000000000000 20000000:01000000:2.0:1790736095.707800:0:6323:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1790736095.707806:0:6323:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1790736095.707810:0:6323:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1790736095.709934:0:6323:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1790736095.709960:0:6323:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1790736095.719624:0:6323:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790736095.720337:0:6323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1790736095.720401:0:6323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1790736095.721294:0:6323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1790736095.721319:0:6323:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790736095.721336:0:6323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000098a7e74d/0x6aae200528fe5fd5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736095.721353:0:6323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000470935ae/0x6aae200528fe5f96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe5f8f expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736095.721361:0:6323:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000098a7e74d/0x6aae200528fe5fd5 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736095.721396:0:6323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000470935ae/0x6aae200528fe5f96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6aae200528fe5f8f expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736095.721412:0:6323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000470935ae/0x6aae200528fe5f96 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6aae200528fe5f8f expref: 11 pid: 5838 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736095.721425:0:6323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073c49d44 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6323:1877722816057216:0@lo:104: 00000100:00100000:2.0:1790736095.721487:0:6323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736095.721583:0:6323:0:(client.c:2716:ptlrpc_set_wait()) set 0000000020e87c94 going to sleep for 11 seconds 00000100:00100000:3.0:1790736095.723876:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816057216 00000100:00100000:3.0:1790736095.723889:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816057216 00000100:00100000:3.0:1790736095.723947:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790736095.723956:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000ac4cb22f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:52e04a2b-4e01-44b7-985c-7db034e22389+3:6323:x1877722816057216:12345-0@lo:104: 00010000:00010000:3.0:1790736095.723973:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: 0000000057fff019/0x6aae200528fe5f8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe5f96 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736095.724394:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790736095.724401:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000ac4cb22f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:52e04a2b-4e01-44b7-985c-7db034e22389+3:6323:x1877722816057216:12345-0@lo:104: Request processed in 446us (2914us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736095.724409:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1790736095.724437:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790736095.724442:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: 0000000057fff019/0x6aae200528fe5f8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe5f96 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736095.724450:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000057fff019 already unused, calling callback (000000004efe8364) 10000000:00010000:3.0:1790736095.724453:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: 0000000057fff019/0x6aae200528fe5f8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6aae200528fe5f96 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736095.724560:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: 0000000057fff019/0x6aae200528fe5f8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6aae200528fe5f96 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790736095.724569:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: 0000000057fff019/0x6aae200528fe5f8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6aae200528fe5f96 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790736095.724575:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790736095.724662:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: 0000000057fff019/0x6aae200528fe5f8f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe5f96 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736095.724669:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790736095.724745:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: 0000000057fff019/0x6aae200528fe5f8f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe5f96 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736095.724753:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: 0000000057fff019/0x6aae200528fe5f8f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe5f96 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736095.724792:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736095.724794:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736095.724796:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736095.725335:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b818ef5a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52e04a2b-4e01-44b7-985c-7db034e22389:3307:1877722816057344:0@lo:103: 00000100:00100000:3.0:1790736095.725384:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736095.726215:0:6323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073c49d44 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6323:1877722816057216:0@lo:104: 00010000:00010000:2.0:1790736095.726244:0:6323:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000098a7e74d/0x6aae200528fe5fd5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736095.726762:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816057344 00000100:00100000:1.0:1790736095.726771:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816057344 00010000:00010000:1.0:1790736095.726814:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000470935ae/0x6aae200528fe5f96 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe5f8f expref: 12 pid: 5838 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736095.726851:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790736095.726859:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000ce43ea3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52e04a2b-4e01-44b7-985c-7db034e22389+12:3307:x1877722816057344:12345-0@lo:103: 00010000:00010000:1.0:1790736095.726872:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736095.726877:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000470935ae/0x6aae200528fe5f96 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe5f8f expref: 12 pid: 5838 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736095.726888:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000470935ae/0x6aae200528fe5f96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6aae200528fe5f8f expref: 12 pid: 5838 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736095.726923:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000470935ae/0x6aae200528fe5f96 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6aae200528fe5f8f expref: 12 pid: 5838 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736095.726936:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000098a7e74d/0x6aae200528fe5fd5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736095.726943:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000098a7e74d/0x6aae200528fe5fd5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736095.726956:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000098a7e74d/0x6aae200528fe5fd5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736095.726963:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000098a7e74d/0x6aae200528fe5fd5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736095.726969:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000098a7e74d/0x6aae200528fe5fd5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736095.726975:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000098a7e74d/0x6aae200528fe5fd5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736095.726981:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000098a7e74d already unused, calling callback (00000000d994fea1) 00010000:00010000:1.0:1790736095.726984:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000098a7e74d/0x6aae200528fe5fd5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736095.726991:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000098a7e74d/0x6aae200528fe5fd5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736095.727016:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000098a7e74d/0x6aae200528fe5fd5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736095.727036:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790736095.727088:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000ce43ea3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52e04a2b-4e01-44b7-985c-7db034e22389+11:3307:x1877722816057344:12345-0@lo:103: Request processed in 230us (1704us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736095.727117:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790736095.727203:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b818ef5a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52e04a2b-4e01-44b7-985c-7db034e22389:3307:1877722816057344:0@lo:103: 00010000:00010000:3.0:1790736095.727238:0:6323:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000098a7e74d/0x6aae200528fe5fd5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736095.727245:0:6323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000098a7e74d/0x6aae200528fe5fd5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736095.727250:0:6323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000098a7e74d/0x6aae200528fe5fd5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736096.021352:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736097.045374:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736098.075480:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790736098.710316:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790736098.710325:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff941604c0d800 from 1 10000000:01000000:2.0:1790736098.710329:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790736098.710372:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: 00000000c395de28/0x6aae200528fe5fdc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736098.710397:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: 00000000c395de28/0x6aae200528fe5fdc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736098.710407:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: 00000000c395de28/0x6aae200528fe5fdc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736098.710428:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073c49d44 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816057472:0@lo:101: 00000100:00100000:2.0:1790736098.710492:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736098.710574:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 0000000084862dd1 going to sleep for 11 seconds 00000100:00100000:3.0:1790736098.714275:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816057472 00000100:00100000:3.0:1790736098.714290:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816057472 00000100:00100000:3.0:1790736098.714400:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790736098.714409:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000006d351abe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+11:5841:x1877722816057472:12345-0@lo:101: 00010000:00010000:3.0:1790736098.714436:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736098.714455:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003513bb39/0x6aae200528fe5fe3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe5fdc expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736098.714482:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003513bb39/0x6aae200528fe5fe3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe5fdc expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736098.714494:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003513bb39/0x6aae200528fe5fe3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe5fdc expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736098.714511:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003513bb39, rc 0) 00000100:00100000:3.0:1790736098.714595:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000006d351abe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+12:5841:x1877722816057472:12345-0@lo:101: Request processed in 187us (4104us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736098.714602:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790736098.714738:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073c49d44 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816057472:0@lo:101: 00010000:00010000:2.0:1790736098.714757:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: 00000000c395de28/0x6aae200528fe5fdc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe5fe3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736098.714776:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: 00000000c395de28/0x6aae200528fe5fdc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe5fe3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736098.714838:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073c49d44 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816057600:0@lo:501: 00000100:00100000:2.0:1790736098.714874:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736098.715880:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 0000000084862dd1 going to sleep for 11 seconds 00000100:00100000:3.0:1790736098.715992:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816057600 00000100:00100000:3.0:1790736098.715999:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816057600 00000100:00100000:3.0:1790736098.716034:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790736098.716041:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000ed256618 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+12:5841:x1877722816057600:12345-0@lo:501: 00000100:00100000:3.0:1790736098.716318:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000ed256618 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+12:5841:x1877722816057600:12345-0@lo:501: Request processed in 278us (1444us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736098.716326:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790736098.716729:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073c49d44 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816057600:0@lo:501: 00000100:00100000:2.0:1790736098.716778:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073c49d44 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816057728:0@lo:503: 00000100:00100000:2.0:1790736098.716822:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736098.716847:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 0000000084862dd1 going to sleep for 11 seconds 00000100:00100000:3.0:1790736098.716889:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816057728 00000100:00100000:3.0:1790736098.716894:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816057728 00000100:00100000:3.0:1790736098.716913:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790736098.716919:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000fb23c665 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+12:5841:x1877722816057728:12345-0@lo:503: 00000100:00100000:3.0:1790736098.717070:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000fb23c665 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+12:5841:x1877722816057728:12345-0@lo:503: Request processed in 151us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736098.717078:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790736098.717191:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073c49d44 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816057728:0@lo:503: 00000100:00100000:2.0:1790736098.717937:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073c49d44 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:6519:1877722816057856:0@lo:502: 00000100:00100000:2.0:1790736098.717983:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736098.718014:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f53f5f0f going to sleep for 11 seconds 00000100:00100000:3.0:1790736098.718056:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816057856 00000100:00100000:3.0:1790736098.718061:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816057856 00000100:00100000:3.0:1790736098.718123:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790736098.718130:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000cd0ab0b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+12:6519:x1877722816057856:12345-0@lo:502: 00000100:00100000:3.0:1790736098.718282:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000cd0ab0b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+12:6519:x1877722816057856:12345-0@lo:502: Request processed in 153us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736098.718289:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790736098.718380:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073c49d44 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:6519:1877722816057856:0@lo:502: 00000020:01000000:2.0:1790736098.718401:0:6519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790736098.718410:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790736098.718412:0:6519:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790736098.718418:0:6519:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff941604c0d800 00000020:00000080:2.0:1790736098.718421:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790736098.718508:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063ac000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:6519:1877722816057984:0@lo:502: 00000100:00100000:2.0:1790736098.718542:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736098.718557:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff94161ee6ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1790736098.718752:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816057984 00000100:00100000:2.0:1790736098.718757:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816057984 00000100:00100000:2.0:1790736098.718794:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790736098.718800:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606654c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+12:6519:x1877722816057984:12345-0@lo:502: 00000100:00100000:2.0:1790736098.719171:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606654c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+12:6519:x1877722816057984:12345-0@lo:502: Request processed in 369us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736098.719179:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790736098.719219:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063ac000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:6519:1877722816057984:0@lo:502: 00000020:01000000:2.0:1790736098.719238:0:6519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790736098.719243:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790736098.719245:0:6519:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1790736098.719248:0:6519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1790736098.719307:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1790736098.719321:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790736098.719330:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff941611930000/0x6aae200528fe5fdc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe5fe3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736098.719354:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff941611930000/0x6aae200528fe5fdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe5fe3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736099.094183:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736100.117747:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736100.501300:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790736100.501338:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52e04a2b-4e01-44b7-985c-7db034e22389:3309:1877722816058112:0@lo:400: 00000100:00100000:1.0:1790736100.501444:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736100.501503:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816058112 00000100:00100000:3.0:1790736100.501516:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816058112 00000100:00100000:1.0:1790736100.501544:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877722816058240:0@lo:400: 00000100:00100000:3.0:1790736100.501580:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790736100.501585:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736100.501595:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606657050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+12:3309:x1877722816058112:12345-0@lo:400: 00000100:00100000:1.0:1790736100.501632:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816058240 00000100:00100000:1.0:1790736100.501638:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816058240 00000100:00100000:3.0:1790736100.501682:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606657050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+12:3309:x1877722816058112:12345-0@lo:400: Request processed in 90us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736100.501685:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790736100.501695:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790736100.501700:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162edc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877722816058240:12345-0@lo:400: 00000100:00100000:1.0:1790736100.501746:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162edc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877722816058240:12345-0@lo:400: Request processed in 51us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736100.501764:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790736100.501808:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94162edc6d80 x1877722816058240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790736116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736100.501824:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877722816058240:0@lo:400: 00000100:00100000:1.0:1790736100.501834:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52e04a2b-4e01-44b7-985c-7db034e22389:3309:1877722816058112:0@lo:400: 00010000:00010000:3.0:1790736101.142060:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736102.165764:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790736102.198209:0:6695:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790736102.198214:0:6695:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1790736102.198352:0:6695:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff94162d353800 00000020:01000004:2.0:1790736102.198370:0:6695:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1790736102.198382:0:6695:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1790736102.198397:0:6695:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff941612f43380) 00000020:00000080:2.0:1790736102.198411:0:6695:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1790736102.211049:0:6695:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1790736102.211254:0:6695:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1790736102.228670:0:6695:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1790736102.233149:0:6695:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1790736102.233189:0:6695:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1790736102.233251:0:6695:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1790736102.233278:0:6695:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1790736102.233698:0:6695:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1790736102.233713:0:6695:0:(osd_handler.c:1577:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790736102.233726:0:6695:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6aae200528fe5ff1 00000020:01000004:2.0:1790736102.233747:0:6695:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1790736102.233775:0:6695:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.105@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790736102.233779:0:6695:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.105@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790736102.233786:0:6695:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1790736102.233791:0:6695:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1790736102.233806:0:6695:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff941612f419c0) 00000020:00000080:2.0:1790736102.233817:0:6695:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1790736102.235291:0:6695:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790736102.235491:0:6695:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1790736102.235498:0:6695:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1790736102.236249:0:6695:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1790736102.236256:0:6695:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1790736102.236644:0:6695:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1790736102.236652:0:6695:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1790736102.238388:0:6695:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790736102.238617:0:6695:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1790736102.238622:0:6695:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1790736102.239213:0:6695:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1790736102.239222:0:6695:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1790736102.263535:0:6695:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790736102.264432:0:6695:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1790736102.264440:0:6695:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1790736102.270780:0:6695:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1790736102.270800:0:6695:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1790736102.272425:0:6695:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1790736102.272440:0:6695:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1790736102.280904:0:6695:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790736102.281827:0:6695:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1790736102.281836:0:6695:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1790736102.283072:0:6695:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1790736102.283084:0:6695:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1790736102.345500:0:6695:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790736102.345912:0:6695:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1790736102.345921:0:6695:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1790736102.350946:0:6695:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1790736102.350972:0:6695:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1790736102.353902:0:6695:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1790736102.353943:0:6695:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1790736102.353950:0:6695:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.105@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1790736102.400766:0:6695:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.105@tcp ctxt 0 is initialized 00000020:01000004:1.0:1790736102.400802:0:6695:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.105@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1790736102.400806:0:6695:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1790736102.400808:0:6695:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790736102.400810:0:6695:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790736102.400811:0:6695:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790736102.400813:0:6695:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790736102.400814:0:6695:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790736102.400815:0:6695:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790736102.400817:0:6695:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790736102.400818:0:6695:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790736102.400819:0:6695:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790736102.400820:0:6695:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790736102.400824:0:6695:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1790736102.400826:0:6695:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790736102.400827:0:6695:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790736102.400828:0:6695:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790736102.400829:0:6695:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790736102.400830:0:6695:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790736102.400831:0:6695:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790736102.400832:0:6695:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790736102.400833:0:6695:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790736102.400835:0:6695:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790736102.400836:0:6695:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790736102.400837:0:6695:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790736102.400861:0:6695:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1790736102.400877:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:6695:1877722816058368:0@lo:253: 00000100:00100000:1.0:1790736102.400942:0:6695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736102.400995:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff94163c5f4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790736102.401288:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816058368 00000100:00100000:2.0:1790736102.401296:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816058368 00000100:00100000:2.0:1790736102.401401:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790736102.401412:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606657850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+12:6695:x1877722816058368:12345-0@lo:253: 20000000:01000000:2.0:1790736102.401448:0:5838:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1790736102.401453:0:5838:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1790736102.401458:0:5838:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1790736102.401461:0:5838:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1790736102.402896:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790736102.403403:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1790736102.403418:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1790736102.403459:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1790736102.403467:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1790736102.403499:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1790736102.403549:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1790736102.404046:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1790736102.404065:0:5838:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.105@tcp 20000000:01000000:2.0:1790736102.404067:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.105@tcp (null) (null) (null) 00000040:00080000:2.0:1790736102.404190:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1790736102.404200:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1790736102.404250:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1790736102.404269:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.105@tcp (null) (null) 00000040:00080000:2.0:1790736102.404304:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1790736102.404314:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1790736102.404345:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1790736102.404395:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1790736102.405315:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1790736102.405333:0:5838:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.105@tcp 20000000:01000000:2.0:1790736102.405335:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.105@tcp (null) (null) (null) 00000040:00080000:2.0:1790736102.405369:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1790736102.405378:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1790736102.405410:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1790736102.405418:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.105@tcp (null) (null) 00000040:00080000:2.0:1790736102.405477:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1790736102.405487:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1790736102.405521:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1790736102.405555:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1790736102.405571:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1790736102.405573:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1790736102.405577:0:5838:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1790736102.406534:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1790736102.406539:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1790736102.406593:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1790736102.406596:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1790736102.407376:0:6710:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1790736102.407446:0:6710:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1790736102.407498:0:6710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1790736102.408460:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1790736102.408500:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1790736102.408536:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1790736102.408547:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1790736102.408549:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1790736102.409288:0:6711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1790736102.409664:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1790736102.409786:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1790736102.409849:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1790736102.409869:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1790736102.409872:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790736102.410502:0:6712:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:1.0:1790736102.410558:0:6712:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:1.0:1790736102.410767:0:6712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1790736102.411016:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1790736102.411053:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1790736102.411380:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1790736102.411397:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1790736102.411400:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1790736102.411407:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1790736102.411426:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff941611931400/0x6aae200528fe5fff lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736102.411445:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff941600031c00/0x6aae200528fe5f18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe5f11 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736102.411453:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94162156ee00/0x6aae200528fe5f34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe5f2d expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736102.411459:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94162156f600/0x6aae200528fe5fa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe5f9d expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736102.411467:0:5838:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff941611931400/0x6aae200528fe5fff lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736102.411500:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94162156f600/0x6aae200528fe5fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6aae200528fe5f9d expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736102.411513:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94162156f600/0x6aae200528fe5fa4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6aae200528fe5f9d expref: 12 pid: 5837 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736102.411527:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063ac000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1877722816058496:0@lo:104: 00000100:00100000:2.0:1790736102.411668:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790736102.411835:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94162156ee00/0x6aae200528fe5f34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6aae200528fe5f2d expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736102.411849:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94162156ee00/0x6aae200528fe5f34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6aae200528fe5f2d expref: 12 pid: 5837 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736102.411858:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063ac700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1877722816058624:0@lo:104: 00000100:00100000:2.0:1790736102.411879:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790736102.411952:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff941600031c00/0x6aae200528fe5f18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6aae200528fe5f11 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736102.411961:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff941600031c00/0x6aae200528fe5f18 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6aae200528fe5f11 expref: 12 pid: 5837 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736102.411969:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063ad500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1877722816058752:0@lo:104: 00000100:00100000:2.0:1790736102.411989:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736102.412047:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816058496 00000100:00100000:3.0:1790736102.412056:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816058496 00000100:00100000:3.0:1790736102.412120:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816058624 00000100:00100000:3.0:1790736102.412124:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816058624 00000100:00100000:3.0:1790736102.412141:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790736102.412151:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52e04a2b-4e01-44b7-985c-7db034e22389+4:5838:x1877722816058496:12345-0@lo:104: 00010000:00010000:3.0:1790736102.412163:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff941600030a00/0x6aae200528fe5f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe5fa4 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736102.412217:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790736102.412223:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52e04a2b-4e01-44b7-985c-7db034e22389+4:5838:x1877722816058496:12345-0@lo:104: Request processed in 74us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736102.412229:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790736102.412249:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790736102.412254:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52e04a2b-4e01-44b7-985c-7db034e22389+3:5838:x1877722816058624:12345-0@lo:104: 00010000:00010000:3.0:1790736102.412261:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff94162156e600/0x6aae200528fe5f2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe5f34 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736102.412306:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790736102.412311:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52e04a2b-4e01-44b7-985c-7db034e22389+3:5838:x1877722816058624:12345-0@lo:104: Request processed in 57us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736102.412317:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1790736102.412334:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790736102.412340:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff941600030a00/0x6aae200528fe5f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe5fa4 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736102.412347:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941600030a00 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:3.0:1790736102.412352:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff941600030a00/0x6aae200528fe5f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6aae200528fe5fa4 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736102.412361:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff941600030a00/0x6aae200528fe5f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6aae200528fe5fa4 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790736102.412369:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff941600030a00/0x6aae200528fe5f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6aae200528fe5fa4 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790736102.412375:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790736102.412404:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff941600030a00/0x6aae200528fe5f9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe5fa4 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736102.412411:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790736102.412429:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff941600030a00/0x6aae200528fe5f9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe5fa4 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736102.412436:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff941600030a00/0x6aae200528fe5f9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe5fa4 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736102.412459:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790736102.412463:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff94162156e600/0x6aae200528fe5f2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe5f34 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736102.412468:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162156e600 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:3.0:1790736102.412471:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff94162156e600/0x6aae200528fe5f2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6aae200528fe5f34 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736102.412479:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff94162156e600/0x6aae200528fe5f2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6aae200528fe5f34 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790736102.412485:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff94162156e600/0x6aae200528fe5f2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6aae200528fe5f34 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790736102.412491:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790736102.412503:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff94162156e600/0x6aae200528fe5f2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe5f34 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736102.412509:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790736102.412514:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff94162156e600/0x6aae200528fe5f2d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe5f34 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736102.412521:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff94162156e600/0x6aae200528fe5f2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe5f34 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736102.412530:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736102.412532:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736102.412534:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736102.412553:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816058880:0@lo:103: 00000100:00100000:3.0:1790736102.412601:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736102.412625:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790736102.412631:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816059008:0@lo:103: 00000100:00100000:3.0:1790736102.412649:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790736102.412796:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736102.413129:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816058880 00000100:00100000:3.0:1790736102.413135:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816058880 00010000:00010000:3.0:1790736102.413160:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94162156f600/0x6aae200528fe5fa4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe5f9d expref: 13 pid: 5837 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736102.413183:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816059008 00000100:00100000:3.0:1790736102.413186:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816059008 00010000:00010000:3.0:1790736102.413196:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94162156ee00/0x6aae200528fe5f34 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe5f2d expref: 14 pid: 5837 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736102.413209:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790736102.413215:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160838d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52e04a2b-4e01-44b7-985c-7db034e22389+14:3306:x1877722816058880:12345-0@lo:103: 00010000:00010000:3.0:1790736102.413226:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790736102.413231:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94162156f600/0x6aae200528fe5fa4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe5f9d expref: 14 pid: 5837 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736102.413240:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94162156f600/0x6aae200528fe5fa4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6aae200528fe5f9d expref: 14 pid: 5837 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736102.413253:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790736102.413286:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160838d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52e04a2b-4e01-44b7-985c-7db034e22389+14:3306:x1877722816058880:12345-0@lo:103: Request processed in 71us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736102.413293:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790736102.413307:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790736102.413313:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160838c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52e04a2b-4e01-44b7-985c-7db034e22389+13:3306:x1877722816059008:12345-0@lo:103: 00010000:00010000:3.0:1790736102.413330:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790736102.413334:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94162156ee00/0x6aae200528fe5f34 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe5f2d expref: 13 pid: 5837 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736102.413343:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94162156ee00/0x6aae200528fe5f34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6aae200528fe5f2d expref: 13 pid: 5837 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736102.413352:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790736102.413374:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160838c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52e04a2b-4e01-44b7-985c-7db034e22389+13:3306:x1877722816059008:12345-0@lo:103: Request processed in 62us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736102.413380:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790736102.413416:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816059008:0@lo:103: 00000100:00100000:3.0:1790736102.413424:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816058880:0@lo:103: 00000100:00100000:2.0:1790736102.413633:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff94160730cd80 going to sleep for 11 seconds 00010000:00010000:2.0:1790736102.413649:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94162156f600/0x6aae200528fe5fa4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6aae200528fe5f9d expref: 12 pid: 5837 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736102.413662:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063ac000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1877722816058496:0@lo:104: 00010000:00010000:2.0:1790736102.413670:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94162156ee00/0x6aae200528fe5f34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6aae200528fe5f2d expref: 11 pid: 5837 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736102.413679:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063ac700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1877722816058624:0@lo:104: 00000100:00100000:3.0:1790736102.413859:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816058752 00000100:00100000:3.0:1790736102.413863:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816058752 00000100:00100000:3.0:1790736102.413885:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790736102.413891:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52e04a2b-4e01-44b7-985c-7db034e22389+3:5838:x1877722816058752:12345-0@lo:104: 00010000:00010000:3.0:1790736102.413900:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff941642173600/0x6aae200528fe5f11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe5f18 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736102.413956:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790736102.413961:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52e04a2b-4e01-44b7-985c-7db034e22389+3:5838:x1877722816058752:12345-0@lo:104: Request processed in 71us (1972us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736102.413967:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1790736102.414010:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790736102.414017:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff941642173600/0x6aae200528fe5f11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe5f18 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736102.414024:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642173600 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:0.0:1790736102.414028:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff941642173600/0x6aae200528fe5f11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6aae200528fe5f18 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736102.414036:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff941642173600/0x6aae200528fe5f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6aae200528fe5f18 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790736102.414043:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff941642173600/0x6aae200528fe5f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6aae200528fe5f18 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790736102.414048:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790736102.414083:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff941642173600/0x6aae200528fe5f11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe5f18 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736102.414090:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790736102.414146:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff941642173600/0x6aae200528fe5f11 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe5f18 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736102.414153:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff941642173600/0x6aae200528fe5f11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe5f18 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736102.414169:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736102.414171:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736102.414172:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790736102.414184:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816059136:0@lo:103: 00000100:00100000:0.0:1790736102.414219:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736102.414304:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816059136 00000100:00100000:3.0:1790736102.414309:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816059136 00010000:00010000:3.0:1790736102.414323:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff941600031c00/0x6aae200528fe5f18 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe5f11 expref: 11 pid: 5837 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736102.414368:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790736102.414376:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162ed92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52e04a2b-4e01-44b7-985c-7db034e22389+11:3308:x1877722816059136:12345-0@lo:103: 00010000:00010000:3.0:1790736102.414402:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790736102.414407:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff941600031c00/0x6aae200528fe5f18 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe5f11 expref: 11 pid: 5837 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736102.414417:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff941600031c00/0x6aae200528fe5f18 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6aae200528fe5f11 expref: 11 pid: 5837 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736102.414429:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff941611931400/0x6aae200528fe5fff lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736102.414436:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941611931400/0x6aae200528fe5fff lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736102.414451:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff941611931400/0x6aae200528fe5fff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736102.414457:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff941611931400/0x6aae200528fe5fff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736102.414462:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff941611931400/0x6aae200528fe5fff lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736102.414468:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff941611931400/0x6aae200528fe5fff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736102.414472:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941611931400 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:3.0:1790736102.414476:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff941611931400/0x6aae200528fe5fff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736102.414488:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff941611931400/0x6aae200528fe5fff lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736102.414496:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff941611931400/0x6aae200528fe5fff lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736102.414505:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790736102.414535:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162ed92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52e04a2b-4e01-44b7-985c-7db034e22389+11:3308:x1877722816059136:12345-0@lo:103: Request processed in 161us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736102.414543:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790736102.414568:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816059136:0@lo:103: 00010000:00010000:2.0:1790736102.415254:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941600031c00/0x6aae200528fe5f18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6aae200528fe5f11 expref: 10 pid: 5837 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736102.415267:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063ad500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1877722816058752:0@lo:104: 00010000:00010000:2.0:1790736102.415283:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff941611931400/0x6aae200528fe5fff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736102.415299:0:5838:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff941611931400/0x6aae200528fe5fff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736102.415305:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff941611931400/0x6aae200528fe5fff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736102.415311:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941611931400/0x6aae200528fe5fff lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790736102.415325:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1790736102.476315:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606657850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+9:6695:x1877722816058368:12345-0@lo:253: Request processed in 74896us (75362us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736102.476329:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790736102.476450:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:6695:1877722816058368:0@lo:253: 10000000:01000000:1.0:1790736102.476466:0:6695:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1790736102.476469:0:6695:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790736102.476471:0:6695:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790736102.476472:0:6695:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790736102.476473:0:6695:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1790736102.476474:0:6695:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790736102.476475:0:6695:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790736102.476477:0:6695:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790736102.476478:0:6695:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1790736102.476480:0:6695:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790736102.476481:0:6695:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790736102.476501:0:6695:0:(tgt_mount.c:101:server_register_mount()) register mount ffff94162d353800 from lustre-OST0000 10000000:01000000:1.0:1790736102.476525:0:6695:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1790736102.476528:0:6695:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1790736102.476535:0:6695:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff94160837b380 local copy 10000000:01000000:1.0:1790736102.476540:0:6695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790736102.476576:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162156e600/0x6aae200528fe6006 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736102.476659:0:6695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.105@tcp lock: ffff94162156e600/0x6aae200528fe6006 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736102.476728:0:6695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff94162156e600/0x6aae200528fe6006 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736102.476758:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:6695:1877722816059264:0@lo:101: 00000100:00100000:1.0:1790736102.476795:0:6695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736102.476910:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816059264 00000100:00100000:0.0:1790736102.476916:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816059264 00000100:00100000:1.0:1790736102.476956:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff94163c5f40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790736102.477298:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790736102.477309:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+9:6695:x1877722816059264:12345-0@lo:101: 00010000:00010000:2.0:1790736102.477323:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736102.477337:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941611931400/0x6aae200528fe600d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe6006 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736102.477359:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941611931400/0x6aae200528fe600d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe6006 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736102.477369:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941611931400/0x6aae200528fe600d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe6006 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736102.477377:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611931400, rc 0) 00000100:00100000:2.0:1790736102.477452:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+10:6695:x1877722816059264:12345-0@lo:101: Request processed in 146us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736102.477474:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790736102.477555:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:6695:1877722816059264:0@lo:101: 00010000:00010000:1.0:1790736102.477575:0:6695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff94162156e600/0x6aae200528fe6006 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x6aae200528fe600d expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736102.477788:0:6695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff94162156e600/0x6aae200528fe6006 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x6aae200528fe600d expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736102.477887:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:6695:1877722816059392:0@lo:501: 00000100:00100000:1.0:1790736102.477914:0:6695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736102.478129:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff94163c5f40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790736102.478210:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816059392 00000100:00100000:2.0:1790736102.478216:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816059392 00000100:00100000:2.0:1790736102.478288:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790736102.478296:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606654050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+10:6695:x1877722816059392:12345-0@lo:501: 00000100:00100000:2.0:1790736102.478498:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606654050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+10:6695:x1877722816059392:12345-0@lo:501: Request processed in 202us (582us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790736102.478507:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790736102.478568:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:6695:1877722816059392:0@lo:501: 10000000:01000000:1.0:1790736102.478596:0:6695:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.105@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1790736102.478622:0:6695:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.105@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1790736102.478628:0:6695:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162156e600/0x6aae200528fe6006 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x6aae200528fe600d expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736102.478636:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162156e600/0x6aae200528fe6006 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x6aae200528fe600d expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736102.478643:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.105@tcp lock: ffff94162156e600/0x6aae200528fe6006 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x6aae200528fe600d expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736102.478661:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790736102.478807:0:6695:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff94162d353800 10000000:01000000:1.0:1790736102.478812:0:6695:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790736102.478817:0:6695:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff94160837b380 10000000:01000000:1.0:1790736102.478820:0:6695:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1790736102.478823:0:6695:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff94160837b380 from 1 10000000:01000000:1.0:1790736102.478825:0:6695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1790736102.478848:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162156ee00/0x6aae200528fe6014 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736102.478863:0:6695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff94162156ee00/0x6aae200528fe6014 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736102.478871:0:6695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff94162156ee00/0x6aae200528fe6014 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736102.478883:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:6695:1877722816059520:0@lo:101: 00000100:00100000:1.0:1790736102.478910:0:6695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736102.479166:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff94163c5f4000 going to sleep for 11 seconds 00010000:00010000:1.0:1790736102.479182:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790736102.479187:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff94162156e600/0x6aae200528fe6006 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x6aae200528fe600d expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736102.479195:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162156e600 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:1.0:1790736102.479199:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff94162156e600/0x6aae200528fe6006 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x6aae200528fe600d expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736102.479207:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff94162156e600/0x6aae200528fe6006 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x6aae200528fe600d expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790736102.479214:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff94162156e600/0x6aae200528fe6006 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x6aae200528fe600d expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790736102.479219:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790736102.479236:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff94162156e600/0x6aae200528fe6006 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x6aae200528fe600d expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736102.479242:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790736102.479260:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff94162156e600/0x6aae200528fe6006 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x6aae200528fe600d expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736102.479273:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff94162156e600/0x6aae200528fe6006 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x6aae200528fe600d expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736102.479287:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736102.479289:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736102.479290:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736102.479298:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790736102.479308:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816059648:0@lo:103: 00000100:00100000:1.0:1790736102.479336:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736102.479363:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816059648 00000100:00100000:1.0:1790736102.479368:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816059648 00000100:00100000:1.0:1790736102.479399:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790736102.479406:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162edc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52e04a2b-4e01-44b7-985c-7db034e22389+10:3308:x1877722816059648:12345-0@lo:103: 00010000:00010000:1.0:1790736102.479416:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736102.479428:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941611931400/0x6aae200528fe600d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6aae200528fe6006 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736102.479441:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790736102.479467:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162edc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52e04a2b-4e01-44b7-985c-7db034e22389+9:3308:x1877722816059648:12345-0@lo:103: Request processed in 62us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736102.479474:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790736102.479502:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816059648:0@lo:103: 00000100:00100000:0.0:1790736102.479782:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816059520 00000100:00100000:0.0:1790736102.479787:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816059520 00000100:00100000:0.0:1790736102.479821:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790736102.479828:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606654450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+9:6695:x1877722816059520:12345-0@lo:101: 00010000:00010000:0.0:1790736102.479838:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736102.479850:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941600030c00/0x6aae200528fe601b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe6014 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736102.479867:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941600030c00/0x6aae200528fe601b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe6014 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736102.479877:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941600030c00/0x6aae200528fe601b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe6014 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736102.479883:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941600030c00, rc 0) 00000100:00100000:0.0:1790736102.479923:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606654450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+10:6695:x1877722816059520:12345-0@lo:101: Request processed in 95us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736102.479939:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790736102.480053:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:6695:1877722816059520:0@lo:101: 00010000:00010000:1.0:1790736102.480065:0:6695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff94162156ee00/0x6aae200528fe6014 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe601b expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736102.480083:0:6695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff94162156ee00/0x6aae200528fe6014 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe601b expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790736102.480129:0:6695:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1790736102.480145:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162156ee00/0x6aae200528fe6014 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe601b expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736102.480153:0:6695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff94162156ee00/0x6aae200528fe6014 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe601b expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790736102.480161:0:6695:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1790736102.480165:0:6695:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790736102.480170:0:6695:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1790736102.480172:0:6695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1790736102.480186:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162156f600/0x6aae200528fe6022 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736102.480194:0:6695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff94162156f600/0x6aae200528fe6022 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736102.480201:0:6695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff94162156f600/0x6aae200528fe6022 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736102.480214:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:6695:1877722816059776:0@lo:101: 00000100:00100000:1.0:1790736102.480239:0:6695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736102.480257:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff94163c5f4000 going to sleep for 11 seconds 00000100:00100000:0.0:1790736102.480352:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816059776 00000100:00100000:0.0:1790736102.480356:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816059776 00000100:00100000:0.0:1790736102.480384:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790736102.480391:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606655050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+10:6695:x1877722816059776:12345-0@lo:101: 00010000:00010000:0.0:1790736102.480398:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736102.480407:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941600030400/0x6aae200528fe6029 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe6022 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736102.480419:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941600030400/0x6aae200528fe6029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe6022 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736102.480427:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941600030400/0x6aae200528fe6029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe6022 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736102.480433:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941600030400, rc 0) 00000100:00100000:0.0:1790736102.480466:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606655050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+11:6695:x1877722816059776:12345-0@lo:101: Request processed in 75us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736102.480471:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790736102.480559:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:6695:1877722816059776:0@lo:101: 00010000:00010000:1.0:1790736102.480569:0:6695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff94162156f600/0x6aae200528fe6022 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6029 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736102.480749:0:6695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff94162156f600/0x6aae200528fe6022 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe6029 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736102.480839:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:6695:1877722816059904:0@lo:501: 00000100:00100000:1.0:1790736102.480865:0:6695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736102.480890:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff94163c5f4000 going to sleep for 11 seconds 00000100:00100000:0.0:1790736102.480940:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816059904 00000100:00100000:0.0:1790736102.480945:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816059904 00000100:00100000:0.0:1790736102.481013:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790736102.481021:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606655c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+11:6695:x1877722816059904:12345-0@lo:501: 00000100:00100000:0.0:1790736102.481253:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606655c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+11:6695:x1877722816059904:12345-0@lo:501: Request processed in 233us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736102.481260:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790736102.481324:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:6695:1877722816059904:0@lo:501: 00000100:00100000:1.0:1790736102.481349:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:6695:1877722816060032:0@lo:503: 00000100:00100000:1.0:1790736102.481385:0:6695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736102.481923:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff94163c5f4000 going to sleep for 11 seconds 00000100:00100000:2.0:1790736102.482029:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816060032 00000100:00100000:2.0:1790736102.482037:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816060032 00000100:00100000:2.0:1790736102.482063:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790736102.482070:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606655850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+11:6695:x1877722816060032:12345-0@lo:503: 00000100:00100000:2.0:1790736102.482258:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606655850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+11:6695:x1877722816060032:12345-0@lo:503: Request processed in 187us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736102.482265:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790736102.482372:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:6695:1877722816060032:0@lo:503: 00000040:00080000:1.0:1790736102.482833:0:6695:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790736102.482897:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:6695:1877722816060160:0@lo:502: 00000100:00100000:1.0:1790736102.482937:0:6695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736102.482960:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff94163c5f4000 going to sleep for 11 seconds 00000100:00100000:2.0:1790736102.483019:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816060160 00000100:00100000:2.0:1790736102.483024:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816060160 00000100:00100000:2.0:1790736102.483045:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790736102.483051:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606654850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+11:6695:x1877722816060160:12345-0@lo:502: 00000100:00100000:2.0:1790736102.483218:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606654850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+11:6695:x1877722816060160:12345-0@lo:502: Request processed in 167us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736102.483225:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790736102.483323:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:6695:1877722816060160:0@lo:502: 00000040:00080000:1.0:1790736102.483571:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1790736102.483808:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1790736102.483845:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1790736102.483894:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1790736102.483931:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1790736102.483965:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1790736102.483993:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:6695:1877722816060288:0@lo:502: 00000100:00100000:1.0:1790736102.484034:0:6695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736102.484058:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff94163c5f4000 going to sleep for 11 seconds 00000100:00100000:2.0:1790736102.484137:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816060288 00000100:00100000:2.0:1790736102.484142:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816060288 00000100:00100000:2.0:1790736102.484164:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790736102.484170:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606655450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+11:6695:x1877722816060288:12345-0@lo:502: 00000100:00100000:2.0:1790736102.484314:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606655450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+11:6695:x1877722816060288:12345-0@lo:502: Request processed in 143us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736102.484321:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790736102.484417:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:6695:1877722816060288:0@lo:502: 00000040:00080000:1.0:1790736102.484497:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1790736102.484507:0:6695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1790736102.485300:0:6714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790736102.485308:0:6714:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1790736102.485315:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790736102.485317:0:6714:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1790736102.485321:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790736102.485343:0:6714:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff941637f6b380) 00000020:00000080:2.0:1790736102.485362:0:6714:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1790736102.485368:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790736102.485433:0:6714:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94162d353800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1790736102.485440:0:6714:0:(osd_handler.c:1577:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790736102.485446:0:6714:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6aae200528fe6037 00010000:00010000:3.0:1790736102.495061:0:6714:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1790736102.495486:0:6714:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1790736102.499931:0:6714:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1790736102.500263:0:6714:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1790736102.517559:0:6714:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1790736102.519310:0:6714:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1790736102.521560:0:6714:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1790736102.521575:0:6714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790736102.521581:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790736102.521583:0:6714:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1790736102.521601:0:6714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790736102.521606:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790736102.521608:0:6714:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790736102.521612:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790736102.521614:0:6714:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790736102.521666:0:6714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790736102.521669:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790736102.521681:0:6714:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790736102.521685:0:6714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1790736102.521990:0:6695:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1790736102.522013:0:6695:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1790736102.522038:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162156f600/0x6aae200528fe6022 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6029 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736102.522050:0:6695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff94162156f600/0x6aae200528fe6022 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6029 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790736102.522059:0:6695:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94162d353800 from 1 10000000:01000000:3.0:1790736102.522061:0:6695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790736102.522124:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff941642173c00/0x6aae200528fe603e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736102.522141:0:6695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff941642173c00/0x6aae200528fe603e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736102.522152:0:6695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff941642173c00/0x6aae200528fe603e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736102.522174:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:6695:1877722816060416:0@lo:101: 00000100:00100000:3.0:1790736102.522236:0:6695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736102.522280:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611651b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790736102.523820:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816060416 00000100:00100000:2.0:1790736102.523833:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816060416 00000100:00100000:2.0:1790736102.523887:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790736102.523897:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606656450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+11:6695:x1877722816060416:12345-0@lo:101: 00010000:00010000:2.0:1790736102.523927:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736102.523943:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941611931000/0x6aae200528fe6045 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe603e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736102.523969:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941611931000/0x6aae200528fe6045 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe603e expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736102.523979:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941611931000/0x6aae200528fe6045 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe603e expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736102.523987:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611931000, rc 0) 00000100:00100000:2.0:1790736102.524049:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606656450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+12:6695:x1877722816060416:12345-0@lo:101: Request processed in 153us (1814us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736102.524056:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790736102.524198:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:6695:1877722816060416:0@lo:101: 00010000:00010000:3.0:1790736102.524216:0:6695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff941642173c00/0x6aae200528fe603e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6045 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736102.524225:0:6695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff941642173c00/0x6aae200528fe603e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe6045 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736102.524329:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:6695:1877722816060544:0@lo:501: 00000100:00100000:3.0:1790736102.524362:0:6695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736102.524400:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611651b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790736102.524449:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816060544 00000100:00100000:2.0:1790736102.524453:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816060544 00000100:00100000:2.0:1790736102.528829:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790736102.528857:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606657450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+12:6695:x1877722816060544:12345-0@lo:501: 00000100:00100000:2.0:1790736102.529179:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606657450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+12:6695:x1877722816060544:12345-0@lo:501: Request processed in 337us (4815us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736102.529187:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790736102.530344:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:6695:1877722816060544:0@lo:501: 00000100:00100000:3.0:1790736102.530398:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:6695:1877722816060672:0@lo:503: 00000100:00100000:3.0:1790736102.531287:0:6695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736102.531331:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611651b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790736102.532170:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816060672 00000100:00100000:0.0:1790736102.532180:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816060672 00000100:00100000:0.0:1790736102.532240:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790736102.532249:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606656c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+12:6695:x1877722816060672:12345-0@lo:503: 00000100:00100000:0.0:1790736102.532532:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606656c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+12:6695:x1877722816060672:12345-0@lo:503: Request processed in 283us (1246us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736102.532540:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790736102.533951:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:6695:1877722816060672:0@lo:503: 00000040:00080000:3.0:1790736102.537358:0:6695:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790736102.537482:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:6695:1877722816060800:0@lo:502: 00000100:00100000:3.0:1790736102.537561:0:6695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736102.537611:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611651b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790736102.537869:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816060800 00000100:00100000:0.0:1790736102.537877:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816060800 00000100:00100000:0.0:1790736102.537931:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790736102.537942:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94161094a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+12:6695:x1877722816060800:12345-0@lo:502: 00000100:00100000:0.0:1790736102.538185:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94161094a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+12:6695:x1877722816060800:12345-0@lo:502: Request processed in 245us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736102.538194:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790736102.538420:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:6695:1877722816060800:0@lo:502: 00000040:00080000:3.0:1790736102.539020:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1790736102.539078:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1790736102.539147:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:6695:1877722816060928:0@lo:502: 00000100:00100000:3.0:1790736102.539192:0:6695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736102.539224:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611651b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790736102.539244:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816060928 00000100:00100000:3.0:1790736102.539250:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816060928 00000100:00100000:3.0:1790736102.539283:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790736102.539291:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94161094bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+12:6695:x1877722816060928:12345-0@lo:502: 00000100:00100000:3.0:1790736102.539431:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94161094bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+12:6695:x1877722816060928:12345-0@lo:502: Request processed in 140us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736102.539438:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790736102.539479:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:6695:1877722816060928:0@lo:502: 00000040:00080000:3.0:1790736102.539557:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1790736102.539567:0:6695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1790736102.545337:0:6718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790736102.545351:0:6718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790736102.545354:0:6718:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790736102.545365:0:6718:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94162d353800 00000020:00000080:3.0:1790736102.545368:0:6718:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790736102.545387:0:6718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790736102.545390:0:6718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790736102.545392:0:6718:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1790736102.545395:0:6718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1790736102.545628:0:6695:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1790736102.545655:0:6695:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790736102.545834:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff941642173c00/0x6aae200528fe603e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6045 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736102.545847:0:6695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff941642173c00/0x6aae200528fe603e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6045 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790736102.545891:0:6695:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1790736102.545894:0:6695:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff94162d353800 10000000:01000000:1.0:1790736102.545897:0:6695:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff94162d353800 10000000:01000000:1.0:1790736102.545900:0:6695:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790736102.545905:0:6695:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94162d353800 from 1 10000000:01000000:1.0:1790736102.545908:0:6695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790736102.545946:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162156e600/0x6aae200528fe604c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736102.545954:0:6695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff94162156e600/0x6aae200528fe604c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736102.545964:0:6695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff94162156e600/0x6aae200528fe604c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736102.545985:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:6695:1877722816061056:0@lo:101: 00000100:00100000:1.0:1790736102.546055:0:6695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736102.546125:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff94163c5f4000 going to sleep for 11 seconds 00000100:00100000:3.0:1790736102.546263:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816061056 00000100:00100000:3.0:1790736102.546271:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816061056 00000100:00100000:3.0:1790736102.546314:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790736102.546323:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941610948c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+12:6695:x1877722816061056:12345-0@lo:101: 00010000:00010000:3.0:1790736102.546339:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736102.546351:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941642173000/0x6aae200528fe6053 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe604c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736102.546376:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941642173000/0x6aae200528fe6053 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe604c expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736102.546387:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941642173000/0x6aae200528fe6053 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe604c expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736102.546397:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941642173000, rc 0) 00000100:00100000:3.0:1790736102.546445:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941610948c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+13:6695:x1877722816061056:12345-0@lo:101: Request processed in 122us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736102.546452:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790736102.546609:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:6695:1877722816061056:0@lo:101: 00010000:00010000:1.0:1790736102.546634:0:6695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff94162156e600/0x6aae200528fe604c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6053 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736102.546642:0:6695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff94162156e600/0x6aae200528fe604c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe6053 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736102.546894:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:6695:1877722816061184:0@lo:501: 00000100:00100000:1.0:1790736102.546919:0:6695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736102.546948:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff94163c5f4000 going to sleep for 11 seconds 00000100:00100000:0.0:1790736102.546996:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816061184 00000100:00100000:0.0:1790736102.547001:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816061184 00000100:00100000:0.0:1790736102.547036:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790736102.547043:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94161094b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+13:6695:x1877722816061184:12345-0@lo:501: 00000100:00100000:0.0:1790736102.547287:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94161094b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+13:6695:x1877722816061184:12345-0@lo:501: Request processed in 244us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736102.547295:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790736102.547468:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:6695:1877722816061184:0@lo:501: 00000100:00100000:1.0:1790736102.547495:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:6695:1877722816061312:0@lo:503: 00000100:00100000:1.0:1790736102.547532:0:6695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736102.547551:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff94163c5f4000 going to sleep for 11 seconds 00000100:00100000:0.0:1790736102.547608:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816061312 00000100:00100000:0.0:1790736102.547614:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816061312 00000100:00100000:0.0:1790736102.547643:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790736102.547650:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94161094b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+13:6695:x1877722816061312:12345-0@lo:503: 00000100:00100000:0.0:1790736102.548048:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94161094b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+13:6695:x1877722816061312:12345-0@lo:503: Request processed in 396us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736102.548055:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790736102.548234:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:6695:1877722816061312:0@lo:503: 00000040:00080000:1.0:1790736102.548508:0:6695:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790736102.548618:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:6695:1877722816061440:0@lo:502: 00000100:00100000:1.0:1790736102.548655:0:6695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736102.548884:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff94163c5f4000 going to sleep for 11 seconds 00000100:00100000:3.0:1790736102.548967:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816061440 00000100:00100000:3.0:1790736102.548973:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816061440 00000100:00100000:3.0:1790736102.549009:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790736102.549017:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94161094a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+13:6695:x1877722816061440:12345-0@lo:502: 00000100:00100000:3.0:1790736102.549215:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94161094a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+13:6695:x1877722816061440:12345-0@lo:502: Request processed in 198us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736102.549222:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790736102.549352:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:6695:1877722816061440:0@lo:502: 00000040:00080000:0.0:1790736102.549781:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1790736102.549833:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1790736102.549867:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1790736102.549915:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1790736102.549956:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1790736102.550019:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1790736102.550057:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1790736102.550089:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1790736102.552036:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1790736102.552080:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1790736102.552146:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1790736102.552199:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1790736102.552252:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1790736102.552287:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1790736102.552336:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1790736102.552371:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1790736102.552404:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1790736102.552453:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1790736102.552507:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1790736102.552541:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1790736102.554021:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1790736102.554815:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1790736102.554863:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1790736102.554921:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1790736102.554955:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1790736102.554988:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1790736102.555052:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1790736102.555089:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1790736102.555782:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:6695:1877722816061568:0@lo:502: 00000100:00100000:1.0:1790736102.555857:0:6695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736102.555906:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff94163c5f4000 going to sleep for 11 seconds 00000100:00100000:0.0:1790736102.556055:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816061568 00000100:00100000:0.0:1790736102.556064:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816061568 00000100:00100000:0.0:1790736102.556285:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790736102.556295:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941610948050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+13:6695:x1877722816061568:12345-0@lo:502: 00000100:00100000:0.0:1790736102.556511:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941610948050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+13:6695:x1877722816061568:12345-0@lo:502: Request processed in 217us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736102.556519:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790736102.556633:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:6695:1877722816061568:0@lo:502: 00000040:00080000:1.0:1790736102.556748:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1790736102.556761:0:6695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1790736102.559530:0:6719:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1790736102.559548:0:6719:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff94163400cd40) 00000020:00000080:3.0:1790736102.559568:0:6719:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1790736102.559653:0:6719:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94162d353800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790736102.559780:0:6719:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94162d353800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790736102.559784:0:6719:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94162d353800 3 00010000:00080000:3.0:1790736102.559814:0:6719:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94163fa00000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.105@tcp at head 00010000:00010000:3.0:1790736102.567346:0:6719:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1790736102.567556:0:6719:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1790736102.568882:0:6719:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790736102.568897:0:6719:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x6aae200528fe6061 00000100:00080000:3.0:1790736102.568908:0:6719:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790736102.568920:0:6719:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff94163fa00000 using connection 192.168.203.105@tcp/0@lo 00000100:00100000:3.0:1790736102.568954:0:6719:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94160838ca80 x1877722816061696/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790736102.568988:0:6719:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1790736102.569200:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1877722816061696:0@lo:38: 00000100:00100000:1.0:1790736102.569272:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736102.571149:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816061696 00000100:00100000:3.0:1790736102.571166:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816061696 00000100:00100000:3.0:1790736102.571219:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790736102.571226:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162edc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1877722816061696:12345-0@lo:38: 00010000:00080000:3.0:1790736102.571255:0:5845:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 174 last 0 00000020:00000080:3.0:1790736102.571293:0:5845:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x6aae200528fe6068 00000004:00100000:3.0:1790736102.571309:0:5845:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790736102.571341:0:5845:0:(import.c:65:import_set_state_nolock()) ffff9416181a9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790736102.571417:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162edc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877722816061696:12345-0@lo:38: Request processed in 190us (2144us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736102.571424:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1790736102.575110:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94160838ca80 x1877722816061696/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790736112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736102.575125:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790736102.575135:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1790736102.575143:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790736102.575148:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790736102.575152:0:3305:0:(import.c:65:import_set_state_nolock()) ffff94163fa00000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790736102.575159:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1877722816061696:0@lo:38: 00000040:00080000:2.0:1790736102.577277:0:6719:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:3.0:1790736102.577490:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877722816061824:0@lo:400: 00000100:00100000:3.0:1790736102.577561:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736102.577894:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816061824 00000100:00100000:2.0:1790736102.577903:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816061824 00000100:00100000:2.0:1790736102.577947:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790736102.577956:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160838df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877722816061824:12345-0@lo:400: 00000100:00100000:2.0:1790736102.578010:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160838df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877722816061824:12345-0@lo:400: Request processed in 54us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736102.578035:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790736102.578074:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9416063ad500 x1877722816061824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790736118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790736102.578086:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877722816061824:0@lo:400: 00000020:01000000:0.0:1790736102.578265:0:6695:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1790736102.578291:0:6695:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790736102.578313:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162156e600/0x6aae200528fe604c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6053 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736102.578323:0:6695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff94162156e600/0x6aae200528fe604c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6053 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790736102.578364:0:6695:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790736102.578366:0:6695:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790736102.578367:0:6695:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790736102.578369:0:6695:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790736102.578370:0:6695:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790736102.578372:0:6695:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790736102.578373:0:6695:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790736102.578375:0:6695:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790736102.578380:0:6695:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790736102.578381:0:6695:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790736102.578383:0:6695:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790736102.578386:0:6695:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1790736102.578389:0:6695:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790736102.578390:0:6695:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790736102.578391:0:6695:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790736102.578392:0:6695:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790736102.578393:0:6695:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790736102.578394:0:6695:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790736102.578395:0:6695:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790736102.578396:0:6695:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790736102.578397:0:6695:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790736102.578398:0:6695:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790736102.578399:0:6695:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790736102.582165:0:6695:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1790736102.582194:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:6695:1877722816061952:0@lo:253: 00000100:00100000:0.0:1790736102.582277:0:6695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736102.582318:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611ca2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790736102.582398:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816061952 00000100:00100000:3.0:1790736102.582407:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816061952 00000100:00100000:3.0:1790736102.582484:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790736102.582494:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941610948450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+13:6695:x1877722816061952:12345-0@lo:253: 20000000:01000000:3.0:1790736102.582526:0:5838:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1790736102.582540:0:5838:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1790736102.628368:0:5838:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1790736102.628385:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1790736102.630459:0:5859:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790736102.630468:0:5859:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790736102.630493:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff941600030600/0x6aae200528fe606f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736102.630512:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff941611930c00/0x6aae200528fe5fce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe5fc7 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736102.630520:0:5859:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff941600030600/0x6aae200528fe606f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736102.630561:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff941611930c00/0x6aae200528fe5fce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6aae200528fe5fc7 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736102.630576:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff941611930c00/0x6aae200528fe5fce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6aae200528fe5fc7 expref: 13 pid: 5836 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736102.630748:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed93100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1877722816062080:0@lo:104: 00000100:00100000:0.0:1790736102.630810:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736102.630931:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816062080 00000100:00100000:2.0:1790736102.630939:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816062080 00000100:00100000:2.0:1790736102.630984:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790736102.630993:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162ed90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52e04a2b-4e01-44b7-985c-7db034e22389+3:5859:x1877722816062080:12345-0@lo:104: 00010000:00010000:2.0:1790736102.631005:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff941642173200/0x6aae200528fe5fc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe5fce expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736102.631054:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790736102.631059:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162ed90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52e04a2b-4e01-44b7-985c-7db034e22389+3:5859:x1877722816062080:12345-0@lo:104: Request processed in 68us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736102.631065:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790736102.631155:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611c7d240 going to sleep for 11 seconds 00000100:00100000:0.0:1790736102.631176:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed93100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1877722816062080:0@lo:104: 00010000:00010000:0.0:1790736102.631193:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff941600030600/0x6aae200528fe606f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736102.631211:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790736102.631216:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff941642173200/0x6aae200528fe5fc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe5fce expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736102.631223:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642173200 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:0.0:1790736102.631227:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff941642173200/0x6aae200528fe5fc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6aae200528fe5fce expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736102.631235:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff941642173200/0x6aae200528fe5fc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6aae200528fe5fce expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790736102.631242:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff941642173200/0x6aae200528fe5fc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6aae200528fe5fce expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790736102.631249:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790736102.631274:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff941642173200/0x6aae200528fe5fc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe5fce expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736102.631281:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790736102.631298:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff941642173200/0x6aae200528fe5fc7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe5fce expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736102.631316:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff941642173200/0x6aae200528fe5fc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe5fce expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736102.631333:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736102.631335:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736102.631336:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790736102.631348:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52e04a2b-4e01-44b7-985c-7db034e22389:3307:1877722816062208:0@lo:103: 00000100:00100000:0.0:1790736102.631380:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736102.635901:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816062208 00000100:00100000:0.0:1790736102.635915:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816062208 00010000:00010000:0.0:1790736102.635950:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff941611930c00/0x6aae200528fe5fce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe5fc7 expref: 14 pid: 5836 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736102.635990:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790736102.635999:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416055c8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52e04a2b-4e01-44b7-985c-7db034e22389+14:3307:x1877722816062208:12345-0@lo:103: 00010000:00010000:0.0:1790736102.636014:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790736102.636020:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff941611930c00/0x6aae200528fe5fce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe5fc7 expref: 14 pid: 5836 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736102.636032:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff941611930c00/0x6aae200528fe5fce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6aae200528fe5fc7 expref: 14 pid: 5836 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736102.636048:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941611930c00/0x6aae200528fe5fce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6aae200528fe5fc7 expref: 14 pid: 5836 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736102.636063:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff941600030600/0x6aae200528fe606f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736102.636089:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941600030600/0x6aae200528fe606f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790736102.636372:0:5829:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005904727s 00010000:00010000:0.0:1790736102.636377:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff941600030600/0x6aae200528fe606f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736102.636385:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff941600030600/0x6aae200528fe606f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736102.636392:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff941600030600/0x6aae200528fe606f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736102.636399:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff941600030600/0x6aae200528fe606f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736102.636405:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941600030600 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:0.0:1790736102.636409:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff941600030600/0x6aae200528fe606f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736102.636418:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff941600030600/0x6aae200528fe606f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736102.636441:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff941600030600/0x6aae200528fe606f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736102.636451:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790736102.636565:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416055c8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52e04a2b-4e01-44b7-985c-7db034e22389+13:3307:x1877722816062208:12345-0@lo:103: Request processed in 566us (5182us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736102.636573:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1790736102.636620:0:5859:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff941600030600/0x6aae200528fe606f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736102.636629:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff941600030600/0x6aae200528fe606f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736102.636636:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941600030600/0x6aae200528fe606f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736102.639894:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52e04a2b-4e01-44b7-985c-7db034e22389:3307:1877722816062208:0@lo:103: 00000100:00100000:1.0:1790736102.641831:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:6695:1877722816061952:0@lo:253: 10000000:01000000:1.0:1790736102.641848:0:6695:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1790736102.641851:0:6695:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790736102.641853:0:6695:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790736102.641854:0:6695:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790736102.641855:0:6695:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790736102.641857:0:6695:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790736102.641858:0:6695:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790736102.641859:0:6695:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790736102.641860:0:6695:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790736102.641862:0:6695:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790736102.641863:0:6695:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790736102.641864:0:6695:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790736102.641877:0:6695:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1790736102.643880:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941610948450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+12:6695:x1877722816061952:12345-0@lo:253: Request processed in 61379us (61593us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736102.643895:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00080000:10000000:3.0:1790736102.651879:0:6695:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1790736102.652122:0:6695:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1790736102.652325:0:6695:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1790736102.652486:0:6695:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1790736102.652887:0:6695:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1790736102.654681:0:6695:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1790736102.656394:0:6695:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1790736102.936443:0:6695:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1790736102.936453:0:6695:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1790736102.936494:0:6695:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790736102.936568:0:6695:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.105@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790736102.936584:0:6695:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1790736102.936613:0:6695:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1790736103.197318:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736104.215061:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790736104.279861:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790736104.279869:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff941604c0d800 from 21 10000000:01000000:0.0:1790736104.279874:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790736104.279923:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe6076 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736104.279933:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe6076 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736104.279943:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe6076 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736104.279965:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816062336:0@lo:101: 00000100:00100000:0.0:1790736104.280031:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736104.280085:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416112c1480 going to sleep for 11 seconds 00000100:00100000:2.0:1790736104.280237:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816062336 00000100:00100000:2.0:1790736104.280245:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816062336 00000100:00100000:2.0:1790736104.280317:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790736104.280326:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941610949050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+12:5841:x1877722816062336:12345-0@lo:101: 00010000:00010000:2.0:1790736104.280341:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736104.280353:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941611930c00/0x6aae200528fe607d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe6076 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736104.280376:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941611930c00/0x6aae200528fe607d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe6076 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736104.280387:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941611930c00/0x6aae200528fe607d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe6076 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736104.280396:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611930c00, rc 0) 00000100:00100000:2.0:1790736104.280446:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941610949050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+13:5841:x1877722816062336:12345-0@lo:101: Request processed in 122us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736104.280453:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790736104.280529:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816062336:0@lo:101: 00010000:00010000:1.0:1790736104.280545:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe6076 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe607d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736104.280553:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe6076 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe607d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736104.280613:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816062464:0@lo:501: 00000100:00100000:1.0:1790736104.280640:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736104.280668:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff94163c5f4780 going to sleep for 11 seconds 00000100:00100000:2.0:1790736104.280833:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816062464 00000100:00100000:2.0:1790736104.280839:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816062464 00000100:00100000:2.0:1790736104.280870:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790736104.280877:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941610949c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+13:5841:x1877722816062464:12345-0@lo:501: 00000100:00100000:2.0:1790736104.281220:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941610949c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+13:5841:x1877722816062464:12345-0@lo:501: Request processed in 342us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736104.281228:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790736104.281307:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816062464:0@lo:501: 00000100:00100000:1.0:1790736104.281343:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816062592:0@lo:503: 00000100:00100000:1.0:1790736104.281380:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736104.281400:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff94163c5f4780 going to sleep for 11 seconds 00000100:00100000:0.0:1790736104.281469:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816062592 00000100:00100000:0.0:1790736104.281474:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816062592 00000100:00100000:0.0:1790736104.281505:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790736104.281513:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941610949850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+13:5841:x1877722816062592:12345-0@lo:503: 00000100:00100000:0.0:1790736104.282031:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941610949850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+13:5841:x1877722816062592:12345-0@lo:503: Request processed in 516us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736104.282038:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790736104.285401:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816062592:0@lo:503: 00000100:00100000:1.0:1790736104.288853:0:6793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:6793:1877722816062720:0@lo:502: 00000100:00100000:1.0:1790736104.288937:0:6793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736104.289012:0:6793:0:(client.c:2716:ptlrpc_set_wait()) set ffff94163c5f4780 going to sleep for 11 seconds 00000100:00100000:3.0:1790736104.290979:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816062720 00000100:00100000:3.0:1790736104.290993:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816062720 00000100:00100000:3.0:1790736104.291052:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790736104.291062:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941610948850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+13:6793:x1877722816062720:12345-0@lo:502: 00000100:00100000:3.0:1790736104.292730:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941610948850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+13:6793:x1877722816062720:12345-0@lo:502: Request processed in 1654us (3777us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736104.292816:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790736104.294217:0:6793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:6793:1877722816062720:0@lo:502: 00000100:00100000:0.0:1790736104.294312:0:6793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed92680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:6793:1877722816062848:0@lo:502: 00000100:00100000:0.0:1790736104.294384:0:6793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736104.294429:0:6793:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607ea1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790736104.294701:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816062848 00000100:00100000:3.0:1790736104.294708:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816062848 00000100:00100000:3.0:1790736104.294888:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790736104.294899:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941610949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+13:6793:x1877722816062848:12345-0@lo:502: 00000100:00100000:3.0:1790736104.295142:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941610949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+13:6793:x1877722816062848:12345-0@lo:502: Request processed in 245us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736104.295151:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790736104.295235:0:6793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed92680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:6793:1877722816062848:0@lo:502: 00000040:00080000:0.0:1790736104.295257:0:6793:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1790736104.298241:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1790736104.298276:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790736104.298288:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe6076 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe607d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736104.298300:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe6076 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe607d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790736104.298309:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790736104.298312:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff941604c0d800 from 4 10000000:01000000:0.0:1790736104.298314:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790736104.298354:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe6084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736104.298363:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe6084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736104.298373:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe6084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736104.298395:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed92680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816062976:0@lo:101: 00000100:00100000:0.0:1790736104.298460:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736104.298504:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607ea1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790736104.298558:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816062976 00000100:00100000:3.0:1790736104.298587:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816062976 00000100:00100000:3.0:1790736104.298634:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790736104.298643:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94161094a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+13:5841:x1877722816062976:12345-0@lo:101: 00010000:00010000:3.0:1790736104.298657:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736104.298669:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941642172200/0x6aae200528fe608b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe6084 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736104.298692:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941642172200/0x6aae200528fe608b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe6084 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736104.298702:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941642172200/0x6aae200528fe608b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe6084 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736104.298709:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941642172200, rc 0) 00000100:00100000:3.0:1790736104.298915:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94161094a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+14:5841:x1877722816062976:12345-0@lo:101: Request processed in 273us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736104.298923:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790736104.299005:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed92680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816062976:0@lo:101: 00010000:00010000:0.0:1790736104.299019:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe6084 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe608b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736104.299040:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe6084 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe608b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736104.299086:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed92680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816063104:0@lo:256: 00000100:00100000:0.0:1790736104.299222:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736104.299286:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607ea1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790736104.302079:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816063104 00000100:00100000:3.0:1790736104.302112:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816063104 00000100:00100000:3.0:1790736104.302170:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790736104.302181:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94161094b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+14:5841:x1877722816063104:12345-0@lo:256: 20000000:01000000:3.0:1790736104.302207:0:5836:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790736104.302233:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790736104.302236:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1790736104.302365:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94161094b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+14:5841:x1877722816063104:12345-0@lo:256: Request processed in 186us (3142us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736104.302372:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790736104.302431:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed92680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816063104:0@lo:256: 10000000:01000000:3.0:1790736104.302479:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790736104.302494:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe6084 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe608b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736104.302505:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe6084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe608b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790736104.302514:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1790736104.302517:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1790736104.302520:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790736104.302549:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff941642173200/0x6aae200528fe6092 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736104.302558:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff941642173200/0x6aae200528fe6092 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736104.302567:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff941642173200/0x6aae200528fe6092 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736104.302597:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816063232:0@lo:101: 00000100:00100000:3.0:1790736104.302627:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736104.302656:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941602e0c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790736104.302669:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816063232 00000100:00100000:3.0:1790736104.302673:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816063232 00000100:00100000:3.0:1790736104.302695:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790736104.302700:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94161094ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+14:5841:x1877722816063232:12345-0@lo:101: 00010000:00010000:3.0:1790736104.302708:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736104.302730:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941642173600/0x6aae200528fe6099 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe6092 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736104.302937:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941642173600/0x6aae200528fe6099 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe6092 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736104.302955:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941642173600/0x6aae200528fe6099 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe6092 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736104.302965:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941642173600, rc 0) 00000100:00100000:3.0:1790736104.303039:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94161094ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+15:5841:x1877722816063232:12345-0@lo:101: Request processed in 338us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736104.303046:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790736104.308356:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816063232:0@lo:101: 00010000:00010000:2.0:1790736104.308388:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff941642173200/0x6aae200528fe6092 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6099 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736104.308401:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff941642173200/0x6aae200528fe6092 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe6099 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736104.308504:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816063360:0@lo:501: 00000100:00100000:2.0:1790736104.308573:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736104.310925:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941605768480 going to sleep for 11 seconds 00000100:00100000:0.0:1790736104.310984:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816063360 00000100:00100000:0.0:1790736104.310993:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816063360 00000100:00100000:0.0:1790736104.311042:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790736104.311050:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416055c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+15:5841:x1877722816063360:12345-0@lo:501: 00000100:00100000:0.0:1790736104.311383:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416055c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+15:5841:x1877722816063360:12345-0@lo:501: Request processed in 331us (2808us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736104.311391:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790736104.311901:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816063360:0@lo:501: 00000100:00100000:2.0:1790736104.311950:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816063488:0@lo:503: 00000100:00100000:2.0:1790736104.311997:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736104.312036:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941605768480 going to sleep for 11 seconds 00000100:00100000:3.0:1790736104.312194:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816063488 00000100:00100000:3.0:1790736104.312199:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816063488 00000100:00100000:3.0:1790736104.312231:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790736104.312239:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416055c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+15:5841:x1877722816063488:12345-0@lo:503: 00000100:00100000:3.0:1790736104.312532:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416055c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+15:5841:x1877722816063488:12345-0@lo:503: Request processed in 293us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736104.312539:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790736104.312633:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816063488:0@lo:503: 00000100:00100000:2.0:1790736104.314998:0:6794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063ad500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:6794:1877722816063616:0@lo:502: 00000100:00100000:2.0:1790736104.315080:0:6794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736104.315148:0:6794:0:(client.c:2716:ptlrpc_set_wait()) set ffff941605768f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790736104.315328:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816063616 00000100:00100000:3.0:1790736104.315337:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816063616 00000100:00100000:3.0:1790736104.315384:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790736104.315392:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416055c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+15:6794:x1877722816063616:12345-0@lo:502: 00000100:00100000:3.0:1790736104.315697:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416055c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+15:6794:x1877722816063616:12345-0@lo:502: Request processed in 305us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736104.315705:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790736104.315883:0:6794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063ad500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:6794:1877722816063616:0@lo:502: 00000020:01000000:0.0:1790736104.315909:0:6794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790736104.315917:0:6794:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1790736104.315924:0:6794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790736104.315926:0:6794:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1790736104.315932:0:6794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790736104.315935:0:6794:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.105@tcp to nid 0x20000c0a8cb69 (192.168.203.105@tcp) 00000020:01000000:0.0:1790736104.315957:0:6794:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1790736104.315960:0:6794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790736104.315973:0:6794:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9416181e19c0) 00000020:00000080:0.0:1790736104.315990:0:6794:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1790736104.315994:0:6794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790736104.316060:0:6794:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1790736104.316066:0:6794:0:(osd_handler.c:1577:osd_obd_connect()) connect #5 00000020:00000080:0.0:1790736104.316079:0:6794:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6aae200528fe60a7 00010000:00080000:0.0:1790736104.316141:0:6794:0:(ldlm_lib.c:102:import_set_conn()) imp ffff941637efa000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.105@tcp at head 00010000:00010000:0.0:1790736104.316369:0:6794:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1790736104.352696:0:6794:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1790736104.352731:0:6794:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1790736104.353340:0:6794:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790736104.353515:0:6794:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790736104.353566:0:6794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1790736104.353623:0:6794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1790736104.355024:0:6795:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790736104.355030:0:6795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1790736104.356238:0:6794:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790736104.356251:0:6794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790736104.356282:0:6794:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1790736104.356304:0:6794:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6aae200528fe60ae 00000100:00080000:2.0:1790736104.356313:0:6794:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790736104.356324:0:6794:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff941637efa000 using connection 192.168.203.105@tcp/0@lo 00000100:00100000:2.0:1790736104.356356:0:6794:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9416063ac700 x1877722816063744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790736104.356409:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1877722816063744:0@lo:8: 00000100:00100000:1.0:1790736104.356473:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736104.356839:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816063744 00000100:00100000:3.0:1790736104.356847:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816063744 00000100:00100000:3.0:1790736104.356876:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790736104.356883:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162edc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1877722816063744:12345-0@lo:8: 00010000:00080000:3.0:1790736104.356905:0:6697:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 176 last 0 00000020:00000080:3.0:1790736104.356936:0:6697:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6aae200528fe60b5 00002000:00100000:3.0:1790736104.356965:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff941501217800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1790736104.356969:0:6697:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1790736104.356973:0:6697:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1790736104.357082:0:6697:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1790736104.357256:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790736104.357279:0:6697:0:(import.c:65:import_set_state_nolock()) ffff941501215800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1790736104.357354:0:6794:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1790736104.357419:0:6794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790736104.357424:0:6794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790736104.357431:0:6794:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1790736104.357434:0:6794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790736104.357439:0:6794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790736104.357440:0:6794:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790736104.357443:0:6794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790736104.357445:0:6794:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1790736104.357469:0:6794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063ac000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:6794:1877722816063872:0@lo:502: 00000100:00100000:2.0:1790736104.357515:0:6794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736104.357562:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816063872 00000100:00100000:2.0:1790736104.357567:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816063872 00000100:00100000:2.0:1790736104.357821:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790736104.357829:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416055c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+15:6794:x1877722816063872:12345-0@lo:502: 00000100:00100000:2.0:1790736104.358016:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416055c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+15:6794:x1877722816063872:12345-0@lo:502: Request processed in 188us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736104.358023:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790736104.358063:0:6794:0:(client.c:2716:ptlrpc_set_wait()) set ffff941605768d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790736104.358084:0:6794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063ac000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:6794:1877722816063872:0@lo:502: 00000020:01000000:2.0:1790736104.358126:0:6794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790736104.358131:0:6794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790736104.358133:0:6794:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790736104.358136:0:6794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:2.0:1790736104.358499:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877722816064000:0@lo:400: 00000100:00100000:2.0:1790736104.358537:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736104.358826:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790736104.358832:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1877722816064128:0@lo:400: 00000100:00100000:2.0:1790736104.358858:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736104.358895:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816064000 00000100:00100000:2.0:1790736104.358900:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816064000 00000100:00100000:2.0:1790736104.358926:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816064128 00000100:00100000:2.0:1790736104.358938:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816064128 00000100:00100000:2.0:1790736104.358963:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790736104.358969:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877722816064000:12345-0@lo:400: 00000100:00100000:2.0:1790736104.359011:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877722816064000:12345-0@lo:400: Request processed in 42us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736104.359017:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790736104.359030:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790736104.359036:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877722816064128:12345-0@lo:400: 00000100:00100000:2.0:1790736104.359063:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877722816064128:12345-0@lo:400: Request processed in 27us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736104.359068:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1790736104.359123:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94162ed90a80 x1877722816064128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790736120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790736104.359136:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1877722816064128:0@lo:400: 00010000:00080000:2.0:1790736104.359147:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94162ed92300 x1877722816064000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790736120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790736104.359153:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877722816064000:0@lo:400: 00000100:00080000:0.0:1790736104.359232:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790736104.360245:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162edc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1877722816063744:12345-0@lo:8: Request processed in 3358us (3768us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736104.360255:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:3.0:1790736104.360282:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1790736104.360304:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1790736104.360313:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff941642173200/0x6aae200528fe6092 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6099 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736104.360325:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff941642173200/0x6aae200528fe6092 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6099 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790736104.360335:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1790736104.360338:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff94160837b380 from 1 10000000:01000000:3.0:1790736104.360341:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790736104.360385:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c8c00/0x6aae200528fe60bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736104.360393:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff94162f8c8c00/0x6aae200528fe60bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736104.360402:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff94162f8c8c00/0x6aae200528fe60bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736104.360428:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816064256:0@lo:101: 00000100:00100000:3.0:1790736104.360466:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736104.360498:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607e0c0c0 going to sleep for 11 seconds 00010000:00080000:1.0:1790736104.360898:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9416063ac700 x1877722816063744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790736114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736104.360909:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790736104.360917:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1790736104.360923:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1790736104.360928:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1790736104.360931:0:3305:0:(import.c:65:import_set_state_nolock()) ffff941637efa000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1790736104.360953:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790736104.360959:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1877722816063744:0@lo:8: 00000100:00100000:2.0:1790736104.361027:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816064256 00000100:00100000:2.0:1790736104.361033:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816064256 00000100:00100000:2.0:1790736104.361067:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790736104.361075:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416055ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+15:5841:x1877722816064256:12345-0@lo:101: 00010000:00010000:2.0:1790736104.361087:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736104.361123:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941611931400/0x6aae200528fe60c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe60bc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736104.361146:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941611931400/0x6aae200528fe60c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe60bc expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736104.361165:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941611931400/0x6aae200528fe60c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe60bc expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736104.361174:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611931400, rc 0) 00000100:00100000:2.0:1790736104.361212:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416055ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+16:5841:x1877722816064256:12345-0@lo:101: Request processed in 138us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736104.361218:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790736104.361250:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816064256:0@lo:101: 00010000:00010000:2.0:1790736104.361262:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff94162f8c8c00/0x6aae200528fe60bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe60c3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736104.361271:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff94162f8c8c00/0x6aae200528fe60bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe60c3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736104.361312:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816064384:0@lo:501: 00000100:00100000:2.0:1790736104.361337:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736104.361351:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941605768840 going to sleep for 11 seconds 00000100:00100000:2.0:1790736104.361363:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816064384 00000100:00100000:2.0:1790736104.361367:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816064384 00000100:00100000:2.0:1790736104.361386:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790736104.361392:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+16:5841:x1877722816064384:12345-0@lo:501: 00000004:00080000:3.0:1790736104.364140:0:6795:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1790736104.364269:0:6795:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 176375174546ns, next at 0ns, rc = 0 00000100:00100000:2.0:1790736104.364361:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+16:5841:x1877722816064384:12345-0@lo:501: Request processed in 2965us (3019us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790736104.364373:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790736104.378582:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816064384:0@lo:501: 10000000:01000000:1.0:1790736104.378632:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1790736104.378661:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c8c00/0x6aae200528fe60bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe60c3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736104.378672:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff94162f8c8c00/0x6aae200528fe60bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe60c3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790736104.420376:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:0.0:1790736104.420863:0:6796:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1790736104.420889:0:6796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed91880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6796:1877722816064640:0@lo:7: 00000100:00100000:0.0:1790736104.420957:0:6796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736104.420999:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816064640 00000100:00100000:0.0:1790736104.421005:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816064640 00000100:00100000:0.0:1790736104.421054:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790736104.421063:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162ed90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6796:x1877722816064640:12345-0@lo:7: 00000100:00100000:3.0:1790736104.422920:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790736104.422941:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816064512:0@lo:13: 00000100:00100000:3.0:1790736104.423004:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736104.423151:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816064512 00000100:00100000:1.0:1790736104.423158:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816064512 00000100:00100000:1.0:1790736104.423201:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790736104.423209:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160838c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1877722816064512:12345-0@lo:13: 00002000:00000024:1.0:1790736104.423238:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1790736104.423287:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160838c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1877722816064512:12345-0@lo:13: Request processed in 78us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736104.423295:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1790736104.423332:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94162ed91f80 x1877722816064512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736120 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736104.423350:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816064512:0@lo:13: 00000100:00080000:1.0:1790736104.423481:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790736104.423495:0:6796:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607ea1480 going to sleep for 11 seconds 00002000:00080000:0.0:1790736104.434469:0:6699:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1790736104.434478:0:6699:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1790736104.434584:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162ed90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6796:x1877722816064640:12345-0@lo:7: Request processed in 13517us (13622us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736104.434596:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790736104.437778:0:6796:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94162ed91880 x1877722816064640/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790736120 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790736104.437810:0:6796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed91880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6796:1877722816064640:0@lo:7: 00000004:00080000:2.0:1790736104.437826:0:6796:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1790736104.437868:0:6796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063aed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6796:1877722816064768:0@lo:5: 00000100:00100000:2.0:1790736104.437925:0:6796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736104.437984:0:6796:0:(client.c:2716:ptlrpc_set_wait()) set ffff941633e94e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790736104.440239:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816064768 00000100:00100000:0.0:1790736104.440254:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816064768 00000100:00100000:0.0:1790736104.440664:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790736104.440683:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6796:x1877722816064768:12345-0@lo:5: 00002000:00080000:0.0:1790736104.440714:0:6697:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1790736104.440727:0:6697:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1790736104.441085:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6796:x1877722816064768:12345-0@lo:5: Request processed in 404us (3159us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1790736104.441116:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1790736104.444259:0:6796:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9416063aed80 x1877722816064768/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790736120 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736104.444281:0:6796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063aed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6796:1877722816064768:0@lo:5: 00000004:00080000:3.0:1790736104.444298:0:6796:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1790736104.444345:0:6796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6796:1877722816064896:0@lo:700: 00000100:00100000:3.0:1790736104.444400:0:6796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736104.444437:0:6796:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607e0c240 going to sleep for 11 seconds 00000100:00100000:1.0:1790736104.445939:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816064896 00000100:00100000:1.0:1790736104.445951:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816064896 00000100:00100000:1.0:1790736104.446002:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790736104.446012:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160838d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6796:x1877722816064896:12345-0@lo:700: 00000100:00100000:1.0:1790736104.446066:0:6706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6706:1877722816065024:0@lo:700: 00000100:00100000:1.0:1790736104.446139:0:6706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736104.446171:0:6706:0:(client.c:2716:ptlrpc_set_wait()) set ffff94163c5f4840 going to sleep for 11 seconds 00000100:00100000:0.0:1790736104.446919:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816065024 00000100:00100000:0.0:1790736104.446927:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816065024 00000100:00100000:0.0:1790736104.447003:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790736104.447012:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162edc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6706:x1877722816065024:12345-0@lo:700: 40000000:02000000:0.0:1790736104.520957:0:5850:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1790736104.531972:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162edc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6706:x1877722816065024:12345-0@lo:700: Request processed in 84952us (85823us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736104.531991:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1790736104.532280:0:6706:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94162edc4a80 x1877722816065024/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790736120 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736104.532306:0:6706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6706:1877722816065024:0@lo:700: 40000000:02000000:1.0:1790736104.532319:0:6706:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:0.0:1790736104.668677:0:6725:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1790736104.668701:0:6725:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1790736104.669326:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160838d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6796:x1877722816064896:12345-0@lo:700: Request processed in 223310us (224920us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736104.669338:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790736104.671931:0:6796:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94160838d180 x1877722816064896/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790736120 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790736104.671948:0:6796:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1790736104.671967:0:6796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6796:1877722816064896:0@lo:700: 00000004:02000040:2.0:1790736104.744662:0:6796:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1790736104.753981:0:6796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6796:1877722816065152:0@lo:5: 00000100:00100000:3.0:1790736104.754047:0:6796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736104.754130:0:6796:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607e0c600 going to sleep for 11 seconds 00000100:00100000:2.0:1790736104.754202:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816065152 00000100:00100000:2.0:1790736104.754210:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816065152 00000100:00100000:2.0:1790736104.754262:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790736104.754271:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160838d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6796:x1877722816065152:12345-0@lo:5: 00002000:00080000:3.0:1790736104.763077:0:6699:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1790736104.763116:0:6699:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1790736104.771161:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160838d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6796:x1877722816065152:12345-0@lo:5: Request processed in 16884us (17106us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1790736104.771174:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790736104.772379:0:6796:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94160838c380 x1877722816065152/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790736120 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790736104.772508:0:6796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6796:1877722816065152:0@lo:5: 00000004:00080000:0.0:1790736104.772523:0:6796:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1790736105.244328:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736106.262268:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736107.285812:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736108.318140:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736109.336632:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736109.717301:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816065280:0@lo:13: 00000100:00100000:1.0:1790736109.717378:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736109.717450:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816065280 00000100:00100000:1.0:1790736109.717459:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816065280 00000100:00100000:1.0:1790736109.717511:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790736109.717535:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162edc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1877722816065280:12345-0@lo:13: 00002000:00000024:1.0:1790736109.717570:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790736109.717612:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162edc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1877722816065280:12345-0@lo:13: Request processed in 94us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736109.717619:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1790736109.717638:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790736109.717669:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94162edc4a80 x1877722816065280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736125 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736109.717699:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816065280:0@lo:13: 00000100:00100000:1.0:1790736109.722410:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816065408:0@lo:400: 00000100:00100000:1.0:1790736109.722484:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736109.722617:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816065408 00000100:00100000:2.0:1790736109.722625:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816065408 00000100:00100000:2.0:1790736109.722668:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790736109.722678:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+16:3308:x1877722816065408:12345-0@lo:400: 00000100:00100000:2.0:1790736109.723153:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+16:3308:x1877722816065408:12345-0@lo:400: Request processed in 60us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736109.723293:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1877722816065664:0@lo:400: 00000100:00100000:3.0:1790736109.723344:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736109.723449:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816065408:0@lo:400: 00000100:00100000:1.0:1790736109.723467:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790736109.723482:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877722816065536:0@lo:400: 00000100:00100000:1.0:1790736109.723507:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736109.723602:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790736109.729690:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816065664 00000100:00100000:2.0:1790736109.729704:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816065664 00000100:00080000:1.0:1790736109.729821:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790736109.729882:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816065536 00000100:00100000:2.0:1790736109.729886:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816065536 00000100:00100000:2.0:1790736109.729906:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790736109.729915:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160838fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877722816065664:12345-0@lo:400: 00000100:00100000:2.0:1790736109.730006:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160838fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877722816065664:12345-0@lo:400: Request processed in 92us (6662us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736109.730013:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790736109.730028:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790736109.730033:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162edc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877722816065536:12345-0@lo:400: 00000100:00100000:2.0:1790736109.730451:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162edc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877722816065536:12345-0@lo:400: Request processed in 415us (6940us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736109.730459:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1790736109.730502:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94162edc7480 x1877722816065664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790736125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790736109.730516:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1877722816065664:0@lo:400: 00010000:00080000:2.0:1790736109.730851:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94162edc4000 x1877722816065536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790736125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790736109.730862:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877722816065536:0@lo:400: 00000001:00080000:0.0:1790736109.837995:0:6725:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1790736110.358505:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790736111.244800:0:7071:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg305-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1790736111.385207:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736112.416345:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736113.432426:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736114.456545:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736114.840263:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52e04a2b-4e01-44b7-985c-7db034e22389:3307:1877722816065792:0@lo:400: 00000100:00100000:1.0:1790736114.840343:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736114.840388:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816066304:0@lo:13: 00000100:00100000:1.0:1790736114.840415:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736114.840448:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790736114.840454:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816066176:0@lo:400: 00000100:00100000:0.0:1790736114.840475:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816066304 00000100:00100000:1.0:1790736114.840476:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736114.840483:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816066304 00000100:00100000:1.0:1790736114.840503:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877722816065920:0@lo:400: 00000100:00100000:1.0:1790736114.840527:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736114.840532:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790736114.840540:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162edc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816066304:12345-0@lo:13: 00000100:00100000:1.0:1790736114.840542:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790736114.840546:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1877722816066048:0@lo:400: 00000100:00100000:1.0:1790736114.840563:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1790736114.840570:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790736114.840588:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816065792 00000100:00100000:1.0:1790736114.840591:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816065792 00000100:00100000:0.0:1790736114.840612:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162edc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816066304:12345-0@lo:13: Request processed in 73us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736114.840616:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790736114.840619:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790736114.840621:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+16:3307:x1877722816065792:12345-0@lo:400: 00000100:00080000:0.0:1790736114.840637:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790736114.840665:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+16:3307:x1877722816065792:12345-0@lo:400: Request processed in 43us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736114.840671:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790736114.840695:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816065920 00000100:00100000:1.0:1790736114.840699:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816065920 00000100:00100000:0.0:1790736114.840702:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52e04a2b-4e01-44b7-985c-7db034e22389:3307:1877722816065792:0@lo:400: 00010000:00080000:0.0:1790736114.840715:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94162edc4000 x1877722816066304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736130 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736114.840719:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816066048 00000100:00100000:0.0:1790736114.840724:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1790736114.840733:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816066048 00000100:00100000:0.0:1790736114.840739:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816066304:0@lo:13: 00000100:00100000:1.0:1790736114.840753:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1790736114.840754:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790736114.840759:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162edc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877722816065920:12345-0@lo:400: 00000100:00100000:1.0:1790736114.840805:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162edc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877722816065920:12345-0@lo:400: Request processed in 46us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736114.840811:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790736114.840822:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790736114.840828:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162edc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877722816066048:12345-0@lo:400: 00000100:00100000:1.0:1790736114.840855:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162edc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877722816066048:12345-0@lo:400: Request processed in 27us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736114.840861:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1790736114.840886:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94162edc5180 x1877722816066048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790736130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790736114.840895:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1877722816066048:0@lo:400: 00010000:00080000:0.0:1790736114.840905:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94162edc4700 x1877722816065920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790736130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790736114.840912:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877722816065920:0@lo:400: 00000100:00100000:0.0:1790736114.841287:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816066176 00000100:00100000:0.0:1790736114.841293:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816066176 00000100:00100000:0.0:1790736114.841318:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790736114.841326:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162edc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816066176:12345-0@lo:400: 00000100:00100000:0.0:1790736114.841364:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162edc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816066176:12345-0@lo:400: Request processed in 40us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736114.841370:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1790736114.841580:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94162edc5500 x1877722816066176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790736114.841589:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816066176:0@lo:400: 00010000:00010000:3.0:1790736115.480221:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736116.501264:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736117.527201:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736118.550169:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736119.576362:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736119.958497:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816066432:0@lo:400: 00000100:00100000:1.0:1790736119.958697:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736119.958753:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790736119.958760:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877722816066560:0@lo:400: 00000100:00100000:1.0:1790736119.958788:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736119.958819:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1877722816066688:0@lo:400: 00000100:00100000:1.0:1790736119.958841:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736119.958859:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790736119.958863:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816066816:0@lo:400: 00000100:00100000:1.0:1790736119.958887:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736119.958924:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816066432 00000100:00100000:1.0:1790736119.958932:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816066432 00000100:00100000:1.0:1790736119.958974:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790736119.958982:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+16:3308:x1877722816066432:12345-0@lo:400: 00000100:00100000:1.0:1790736119.959043:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+16:3308:x1877722816066432:12345-0@lo:400: Request processed in 62us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736119.959050:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790736119.959078:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816066560 00000100:00100000:1.0:1790736119.959081:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816066560 00000100:00100000:3.0:1790736119.962123:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790736119.962157:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816066944:0@lo:13: 00000100:00100000:1.0:1790736119.962386:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816066688 00000100:00100000:1.0:1790736119.962393:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816066688 00000100:00100000:1.0:1790736119.962436:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790736119.962456:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162edc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877722816066560:12345-0@lo:400: 00000100:00100000:1.0:1790736119.962524:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162edc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877722816066560:12345-0@lo:400: Request processed in 71us (3735us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736119.962531:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790736119.963303:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790736119.963317:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162edc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877722816066688:12345-0@lo:400: 00000100:00100000:2.0:1790736119.963387:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162edc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877722816066688:12345-0@lo:400: Request processed in 75us (4544us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736119.963394:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790736119.964333:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816066816 00000100:00100000:2.0:1790736119.964342:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816066816 00000100:00100000:2.0:1790736119.964389:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790736119.964397:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162edc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816066816:12345-0@lo:400: 00000100:00100000:2.0:1790736119.964447:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162edc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816066816:12345-0@lo:400: Request processed in 51us (5559us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736119.964454:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790736119.964508:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94162edc6a00 x1877722816066560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790736135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790736119.964522:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877722816066560:0@lo:400: 00000100:00100000:2.0:1790736119.964533:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816066432:0@lo:400: 00000100:00080000:1.0:1790736119.964707:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790736119.964712:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790736119.964734:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94162edc4700 x1877722816066816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736119.964745:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816066816:0@lo:400: 00010000:00080000:1.0:1790736119.964757:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94162edc5500 x1877722816066688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790736135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736119.964766:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1877722816066688:0@lo:400: 00000100:00100000:3.0:1790736119.965298:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736119.967175:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816066944 00000100:00100000:1.0:1790736119.967190:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816066944 00000100:00100000:1.0:1790736119.967258:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790736119.967268:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160838e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816066944:12345-0@lo:13: 00002000:00000024:1.0:1790736119.967303:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790736119.967377:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160838e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816066944:12345-0@lo:13: Request processed in 111us (2080us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736119.967398:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1790736119.969527:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94160838f480 x1877722816066944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736135 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736119.969561:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816066944:0@lo:13: 00010000:00010000:3.0:1790736120.604315:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736121.621879:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736122.646765:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736123.669374:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790736124.620340:0:7641:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790736124.620344:0:7641:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1790736124.620891:0:7641:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff94162d364800 00000020:01000004:3.0:1790736124.620907:0:7641:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1790736124.620920:0:7641:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1790736124.620934:0:7641:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff94163400b380) 00000020:00000080:3.0:1790736124.620949:0:7641:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1790736124.646032:0:7641:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1790736124.646590:0:7641:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00010000:00010000:0.0:1790736124.695763:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1790736124.695767:0:7641:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1790736124.707881:0:7641:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1790736124.707915:0:7641:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1790736124.707969:0:7641:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1790736124.707994:0:7641:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1790736124.713500:0:7641:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1790736124.713536:0:7641:0:(osd_handler.c:1577:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790736124.714222:0:7641:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6aae200528fe60d1 00000020:01000004:2.0:1790736124.714234:0:7641:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1790736124.714256:0:7641:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.105@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790736124.714260:0:7641:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.105@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790736124.714268:0:7641:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1790736124.714407:0:7641:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1790736124.714412:0:7641:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.105@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1790736124.756069:0:7641:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.105@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790736124.756146:0:7641:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.105@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1790736124.756150:0:7641:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790736124.756152:0:7641:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790736124.756153:0:7641:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790736124.756155:0:7641:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790736124.756156:0:7641:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790736124.756157:0:7641:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790736124.756158:0:7641:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790736124.756159:0:7641:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790736124.756161:0:7641:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790736124.756163:0:7641:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790736124.756164:0:7641:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790736124.756168:0:7641:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1790736124.756171:0:7641:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790736124.756172:0:7641:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790736124.756173:0:7641:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790736124.756174:0:7641:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790736124.756175:0:7641:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790736124.756176:0:7641:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790736124.756177:0:7641:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790736124.756178:0:7641:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790736124.756179:0:7641:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790736124.756180:0:7641:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790736124.756181:0:7641:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790736124.756206:0:7641:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1790736124.756223:0:7641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:7641:1877722816067072:0@lo:253: 00000100:00100000:3.0:1790736124.756740:0:7641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736124.756828:0:7641:0:(client.c:2716:ptlrpc_set_wait()) set ffff94163f9cef00 going to sleep for 11 seconds 00000100:00100000:1.0:1790736124.759267:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816067072 00000100:00100000:1.0:1790736124.759488:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816067072 00000100:00100000:1.0:1790736124.759556:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790736124.759567:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+16:7641:x1877722816067072:12345-0@lo:253: 20000000:01000000:1.0:1790736124.759721:0:5837:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1790736124.759725:0:5837:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1790736124.759730:0:5837:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1790736124.759733:0:5837:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1790736124.761122:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790736124.761724:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1790736124.761741:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1790736124.761780:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1790736124.761788:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1790736124.761816:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1790736124.761865:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1790736124.763671:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1790736124.763701:0:5837:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.105@tcp 20000000:01000000:1.0:1790736124.763703:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.105@tcp (null) (null) (null) 00000040:00080000:1.0:1790736124.763740:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1790736124.763748:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1790736124.763823:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1790736124.763832:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.105@tcp (null) (null) 00000040:00080000:1.0:1790736124.763867:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1790736124.763877:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1790736124.763907:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1790736124.763957:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1790736124.766036:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1790736124.766066:0:5837:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.105@tcp 20000000:01000000:1.0:1790736124.766068:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.105@tcp (null) (null) (null) 00000040:00080000:1.0:1790736124.767052:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1790736124.767069:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1790736124.767192:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1790736124.767201:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.105@tcp (null) (null) 00000040:00080000:1.0:1790736124.767231:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1790736124.767239:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1790736124.767298:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1790736124.767534:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1790736124.767556:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1790736124.767559:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1790736124.767562:0:5837:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1790736124.767658:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1790736124.767662:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1790736124.767704:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1790736124.767707:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790736124.768582:0:7643:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1790736124.768647:0:7643:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1790736124.768702:0:7643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1790736124.769077:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1790736124.769641:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1790736124.769679:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1790736124.769694:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1790736124.769696:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790736124.770894:0:7644:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1790736124.770985:0:7644:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1790736124.771019:0:7644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1790736124.771723:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1790736124.771763:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1790736124.771889:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1790736124.771905:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1790736124.771920:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1790736124.772718:0:7645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1790736124.773082:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1790736124.773545:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1790736124.773635:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1790736124.773650:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1790736124.773652:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790736124.774277:0:7646:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1790736124.775068:0:7646:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1790736124.775176:0:7646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1790736124.775719:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1790736124.775759:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1790736124.776607:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1790736124.776639:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1790736124.776641:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1790736124.776651:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1790736124.776670:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff941600030600/0x6aae200528fe60d8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736124.776690:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff941600030400/0x6aae200528fe6029 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe6022 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736124.776698:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff941642173000/0x6aae200528fe6053 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe604c expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736124.776705:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff941611930c00/0x6aae200528fe607d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe6076 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736124.776711:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff941642173600/0x6aae200528fe6099 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe6092 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736124.776717:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff941611931400/0x6aae200528fe60c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe60bc expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736124.776725:0:5837:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff941600030600/0x6aae200528fe60d8 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736124.776783:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff941611931400/0x6aae200528fe60c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6aae200528fe60bc expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736124.776797:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff941611931400/0x6aae200528fe60c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6aae200528fe60bc expref: 16 pid: 5838 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736124.776812:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed93480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5837:1877722816067200:0@lo:104: 00000100:00100000:0.0:1790736124.776956:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790736124.777011:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff941642173600/0x6aae200528fe6099 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6aae200528fe6092 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736124.777018:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff941642173600/0x6aae200528fe6099 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6aae200528fe6092 expref: 16 pid: 5837 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736124.777026:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed93b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5837:1877722816067328:0@lo:104: 00010000:00010000:0.0:1790736124.777049:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff941611930c00/0x6aae200528fe607d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6aae200528fe6076 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736124.777057:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff941611930c00/0x6aae200528fe607d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6aae200528fe6076 expref: 16 pid: 5837 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736124.777065:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed91880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5837:1877722816067456:0@lo:104: 00000100:00100000:1.0:1790736124.777188:0:5826:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1790736124.777207:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736124.777333:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816067200 00000100:00100000:1.0:1790736124.777342:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816067200 00000100:00100000:0.0:1790736124.777403:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790736124.777727:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff941642173000/0x6aae200528fe6053 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6aae200528fe604c expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736124.777739:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff941642173000/0x6aae200528fe6053 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6aae200528fe604c expref: 16 pid: 5836 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736124.777758:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed92300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5837:1877722816067584:0@lo:104: 00000100:00100000:0.0:1790736124.777784:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736124.777801:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816067328 00000100:00100000:3.0:1790736124.777806:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816067328 00000100:00100000:3.0:1790736124.777837:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816067456 00000100:00100000:3.0:1790736124.777840:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816067456 00000100:00100000:3.0:1790736124.777853:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790736124.777861:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941610fbf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52e04a2b-4e01-44b7-985c-7db034e22389+5:5837:x1877722816067200:12345-0@lo:104: 00010000:00010000:3.0:1790736124.777875:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff94162f8c8c00/0x6aae200528fe60bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe60c3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736124.777974:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790736124.777981:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941610fbf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52e04a2b-4e01-44b7-985c-7db034e22389+5:5837:x1877722816067200:12345-0@lo:104: Request processed in 121us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736124.777989:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790736124.778042:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790736124.778049:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162edc5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52e04a2b-4e01-44b7-985c-7db034e22389+4:5837:x1877722816067328:12345-0@lo:104: 00010000:00010000:3.0:1790736124.778057:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff941642173200/0x6aae200528fe6092 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe6099 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736124.778269:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790736124.778276:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff94162f8c8c00/0x6aae200528fe60bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe60c3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736124.778295:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c8c00 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:2.0:1790736124.778299:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff94162f8c8c00/0x6aae200528fe60bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x6aae200528fe60c3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736124.778307:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff94162f8c8c00/0x6aae200528fe60bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x6aae200528fe60c3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790736124.778329:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff94162f8c8c00/0x6aae200528fe60bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x6aae200528fe60c3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790736124.778335:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790736124.778365:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff94162f8c8c00/0x6aae200528fe60bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe60c3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736124.778372:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790736124.778392:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff94162f8c8c00/0x6aae200528fe60bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe60c3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736124.778399:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff94162f8c8c00/0x6aae200528fe60bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe60c3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736124.778411:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790736124.778414:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff941642173200/0x6aae200528fe6092 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe6099 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736124.778419:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642173200 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:2.0:1790736124.778421:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff941642173200/0x6aae200528fe6092 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x6aae200528fe6099 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736124.778448:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff941642173200/0x6aae200528fe6092 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x6aae200528fe6099 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790736124.778455:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff941642173200/0x6aae200528fe6092 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x6aae200528fe6099 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790736124.778461:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790736124.778484:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff941642173200/0x6aae200528fe6092 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe6099 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736124.778491:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790736124.778503:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff941642173200/0x6aae200528fe6092 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe6099 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736124.778509:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff941642173200/0x6aae200528fe6092 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe6099 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736124.778520:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736124.778521:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736124.778523:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790736124.778531:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790736124.778543:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816067712:0@lo:103: 00000100:00100000:2.0:1790736124.778590:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736124.778627:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816067712 00000100:00100000:2.0:1790736124.778632:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816067712 00010000:00010000:2.0:1790736124.778653:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff941611931400/0x6aae200528fe60c3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe60bc expref: 17 pid: 5838 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736124.778680:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790736124.778686:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52e04a2b-4e01-44b7-985c-7db034e22389+17:3308:x1877722816067712:12345-0@lo:103: 00010000:00010000:2.0:1790736124.778702:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790736124.778707:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff941611931400/0x6aae200528fe60c3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe60bc expref: 17 pid: 5838 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736124.778717:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff941611931400/0x6aae200528fe60c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6aae200528fe60bc expref: 17 pid: 5838 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736124.778732:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790736124.778761:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52e04a2b-4e01-44b7-985c-7db034e22389+17:3308:x1877722816067712:12345-0@lo:103: Request processed in 75us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736124.778767:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790736124.778800:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816067712:0@lo:103: 00000100:00100000:1.0:1790736124.779127:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816067840:0@lo:103: 00000100:00100000:1.0:1790736124.779159:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736124.779204:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816067840 00000100:00100000:1.0:1790736124.779208:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816067840 00010000:00010000:1.0:1790736124.779225:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff941642173600/0x6aae200528fe6099 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe6092 expref: 17 pid: 5837 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736124.779244:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790736124.779249:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162edc4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52e04a2b-4e01-44b7-985c-7db034e22389+17:3306:x1877722816067840:12345-0@lo:103: 00010000:00010000:1.0:1790736124.779257:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736124.779261:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff941642173600/0x6aae200528fe6099 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe6092 expref: 17 pid: 5837 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736124.779278:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff941642173600/0x6aae200528fe6099 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6aae200528fe6092 expref: 17 pid: 5837 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736124.779288:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790736124.779332:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162edc4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52e04a2b-4e01-44b7-985c-7db034e22389+17:3306:x1877722816067840:12345-0@lo:103: Request processed in 82us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736124.779338:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790736124.779363:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816067840:0@lo:103: 00010000:00010000:3.0:1790736124.782811:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1790736124.782842:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162edc5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52e04a2b-4e01-44b7-985c-7db034e22389+4:5837:x1877722816067328:12345-0@lo:104: Request processed in 4787us (5626us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736124.782853:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1790736124.783049:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736124.783234:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff941600030400/0x6aae200528fe6029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6aae200528fe6022 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736124.783251:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff941600030400/0x6aae200528fe6029 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6aae200528fe6022 expref: 16 pid: 5837 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736124.783266:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed92680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5837:1877722816067968:0@lo:104: 00000100:00100000:0.0:1790736124.783338:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736124.783350:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff941637e58b40 going to sleep for 11 seconds 00010000:00010000:0.0:1790736124.783373:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941611931400/0x6aae200528fe60c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6aae200528fe60bc expref: 16 pid: 5838 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736124.783384:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed93480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5837:1877722816067200:0@lo:104: 00010000:00010000:0.0:1790736124.783396:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941642173600/0x6aae200528fe6099 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6aae200528fe6092 expref: 15 pid: 5837 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736124.783405:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed93b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5837:1877722816067328:0@lo:104: 00000100:00100000:1.0:1790736124.783621:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816067584 00000100:00100000:1.0:1790736124.783628:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816067584 00000100:00100000:1.0:1790736124.783658:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816067968 00000100:00100000:1.0:1790736124.783661:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816067968 00000100:00100000:1.0:1790736124.783676:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790736124.783686:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162ed91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:52e04a2b-4e01-44b7-985c-7db034e22389+5:5837:x1877722816067456:12345-0@lo:104: 00010000:00010000:1.0:1790736124.783698:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe6076 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe607d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736124.783760:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790736124.783766:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162ed91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:52e04a2b-4e01-44b7-985c-7db034e22389+5:5837:x1877722816067456:12345-0@lo:104: Request processed in 82us (6363us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736124.783772:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790736124.783787:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790736124.783793:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162ed90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:52e04a2b-4e01-44b7-985c-7db034e22389+4:5837:x1877722816067584:12345-0@lo:104: 00010000:00010000:1.0:1790736124.783801:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff94162156e600/0x6aae200528fe604c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe6053 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736124.783866:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790736124.783872:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162ed90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:52e04a2b-4e01-44b7-985c-7db034e22389+4:5837:x1877722816067584:12345-0@lo:104: Request processed in 79us (6086us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736124.783878:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790736124.783891:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790736124.783897:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162ed92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:52e04a2b-4e01-44b7-985c-7db034e22389+3:5837:x1877722816067968:12345-0@lo:104: 00010000:00010000:1.0:1790736124.783904:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff94162156f600/0x6aae200528fe6022 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe6029 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736124.783927:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1790736124.783932:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162ed92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:52e04a2b-4e01-44b7-985c-7db034e22389+3:5837:x1877722816067968:12345-0@lo:104: Request processed in 37us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736124.783937:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1790736124.783953:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790736124.783959:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe6076 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe607d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736124.783966:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941600030800 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:1.0:1790736124.783971:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe6076 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6aae200528fe607d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736124.783979:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe6076 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6aae200528fe607d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790736124.783987:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe6076 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6aae200528fe607d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790736124.783992:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790736124.784026:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe6076 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe607d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736124.784034:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790736124.784050:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe6076 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe607d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736124.784057:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe6076 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe607d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736124.784068:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790736124.784071:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff94162156e600/0x6aae200528fe604c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe6053 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736124.784077:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162156e600 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:1.0:1790736124.784080:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff94162156e600/0x6aae200528fe604c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6aae200528fe6053 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736124.784086:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff94162156e600/0x6aae200528fe604c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6aae200528fe6053 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790736124.784119:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff94162156e600/0x6aae200528fe604c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6aae200528fe6053 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790736124.784124:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790736124.784137:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff94162156e600/0x6aae200528fe604c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe6053 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736124.784143:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790736124.784160:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff94162156e600/0x6aae200528fe604c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe6053 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736124.784178:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff94162156e600/0x6aae200528fe604c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe6053 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736124.784187:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790736124.784190:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff94162156f600/0x6aae200528fe6022 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe6029 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736124.784196:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162156f600 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:1.0:1790736124.784198:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff94162156f600/0x6aae200528fe6022 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6aae200528fe6029 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736124.784206:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff94162156f600/0x6aae200528fe6022 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6aae200528fe6029 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790736124.784211:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff94162156f600/0x6aae200528fe6022 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6aae200528fe6029 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790736124.784216:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790736124.784244:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff94162156f600/0x6aae200528fe6022 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe6029 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736124.784250:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790736124.784255:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff94162156f600/0x6aae200528fe6022 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe6029 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736124.784261:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff94162156f600/0x6aae200528fe6022 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe6029 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736124.784274:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736124.784281:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736124.784283:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736124.784295:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52e04a2b-4e01-44b7-985c-7db034e22389:3307:1877722816068096:0@lo:103: 00000100:00100000:1.0:1790736124.784532:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736124.784591:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52e04a2b-4e01-44b7-985c-7db034e22389:3309:1877722816068352:0@lo:103: 00000100:00100000:1.0:1790736124.784617:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736124.784636:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790736124.784641:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52e04a2b-4e01-44b7-985c-7db034e22389:3309:1877722816068224:0@lo:103: 00000100:00100000:1.0:1790736124.784659:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736124.784688:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816068096 00000100:00100000:1.0:1790736124.784694:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816068096 00010000:00010000:1.0:1790736124.784715:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff941611930c00/0x6aae200528fe607d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe6076 expref: 15 pid: 5837 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736124.784730:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816068352 00000100:00100000:1.0:1790736124.784732:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816068352 00010000:00010000:1.0:1790736124.784741:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff941600030400/0x6aae200528fe6029 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe6022 expref: 16 pid: 5837 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736124.784751:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816068224 00000100:00100000:1.0:1790736124.784753:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816068224 00010000:00010000:1.0:1790736124.784763:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff941642173000/0x6aae200528fe6053 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe604c expref: 17 pid: 5836 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736124.784775:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790736124.784781:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52e04a2b-4e01-44b7-985c-7db034e22389+17:3307:x1877722816068096:12345-0@lo:103: 00010000:00010000:1.0:1790736124.784794:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736124.784799:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff941611930c00/0x6aae200528fe607d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe6076 expref: 17 pid: 5837 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736124.784832:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff941611930c00/0x6aae200528fe607d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6aae200528fe6076 expref: 17 pid: 5837 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736124.784847:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790736124.784876:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52e04a2b-4e01-44b7-985c-7db034e22389+17:3307:x1877722816068096:12345-0@lo:103: Request processed in 95us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736124.784883:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790736124.784897:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790736124.784903:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52e04a2b-4e01-44b7-985c-7db034e22389+16:3309:x1877722816068352:12345-0@lo:103: 00010000:00010000:1.0:1790736124.784910:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736124.784913:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff941600030400/0x6aae200528fe6029 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe6022 expref: 16 pid: 5837 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736124.784922:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff941600030400/0x6aae200528fe6029 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6aae200528fe6022 expref: 16 pid: 5837 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736124.784931:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790736124.784955:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52e04a2b-4e01-44b7-985c-7db034e22389+16:3309:x1877722816068352:12345-0@lo:103: Request processed in 52us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736124.784960:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790736124.784970:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790736124.784975:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52e04a2b-4e01-44b7-985c-7db034e22389+15:3309:x1877722816068224:12345-0@lo:103: 00010000:00010000:1.0:1790736124.784980:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736124.784983:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff941642173000/0x6aae200528fe6053 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe604c expref: 15 pid: 5836 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736124.784992:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff941642173000/0x6aae200528fe6053 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6aae200528fe604c expref: 15 pid: 5836 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736124.785008:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff941600030600/0x6aae200528fe60d8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736124.785017:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941600030600/0x6aae200528fe60d8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736124.785031:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff941600030600/0x6aae200528fe60d8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736124.785038:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff941600030600/0x6aae200528fe60d8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736124.785045:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff941600030600/0x6aae200528fe60d8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736124.785051:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff941600030600/0x6aae200528fe60d8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736124.785057:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941600030600 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:1.0:1790736124.785061:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff941600030600/0x6aae200528fe60d8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736124.785067:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff941600030600/0x6aae200528fe60d8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736124.785076:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff941600030600/0x6aae200528fe60d8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736124.785084:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790736124.785134:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52e04a2b-4e01-44b7-985c-7db034e22389+15:3309:x1877722816068224:12345-0@lo:103: Request processed in 158us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736124.785152:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790736124.785194:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52e04a2b-4e01-44b7-985c-7db034e22389:3309:1877722816068224:0@lo:103: 00000100:00100000:1.0:1790736124.785202:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52e04a2b-4e01-44b7-985c-7db034e22389:3309:1877722816068352:0@lo:103: 00000100:00100000:1.0:1790736124.785229:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52e04a2b-4e01-44b7-985c-7db034e22389:3307:1877722816068096:0@lo:103: 00010000:00010000:2.0:1790736124.785470:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736124.785686:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941611930c00/0x6aae200528fe607d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6aae200528fe6076 expref: 14 pid: 5837 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736124.785698:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed91880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5837:1877722816067456:0@lo:104: 00010000:00010000:0.0:1790736124.785708:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941642173000/0x6aae200528fe6053 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6aae200528fe604c expref: 13 pid: 5836 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736124.785717:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed92300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5837:1877722816067584:0@lo:104: 00010000:00010000:0.0:1790736124.785736:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941600030400/0x6aae200528fe6029 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6aae200528fe6022 expref: 12 pid: 5837 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736124.785745:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed92680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5837:1877722816067968:0@lo:104: 00010000:00010000:0.0:1790736124.785769:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff941600030600/0x6aae200528fe60d8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736124.785779:0:5837:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff941600030600/0x6aae200528fe60d8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736124.785784:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff941600030600/0x6aae200528fe60d8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736124.785791:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941600030600/0x6aae200528fe60d8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790736124.785803:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1790736124.874811:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+11:7641:x1877722816067072:12345-0@lo:253: Request processed in 115237us (118062us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736124.874825:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790736124.874912:0:7641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:7641:1877722816067072:0@lo:253: 10000000:01000000:3.0:1790736124.874927:0:7641:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1790736124.874930:0:7641:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790736124.874944:0:7641:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790736124.874945:0:7641:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790736124.874946:0:7641:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1790736124.874948:0:7641:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790736124.874949:0:7641:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790736124.874950:0:7641:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790736124.874952:0:7641:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1790736124.874953:0:7641:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790736124.874954:0:7641:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790736124.874976:0:7641:0:(tgt_mount.c:101:server_register_mount()) register mount ffff94162d364800 from lustre-OST0001 10000000:01000000:3.0:1790736124.875005:0:7641:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1790736124.875008:0:7641:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1790736124.875017:0:7641:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff94160837b380 local copy 10000000:01000000:3.0:1790736124.875022:0:7641:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790736124.875061:0:7641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c8800/0x6aae200528fe60df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736124.875072:0:7641:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.105@tcp lock: ffff94162f8c8800/0x6aae200528fe60df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736124.875081:0:7641:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff94162f8c8800/0x6aae200528fe60df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736124.875126:0:7641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:7641:1877722816068480:0@lo:101: 00000100:00100000:3.0:1790736124.875164:0:7641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736124.875304:0:7641:0:(client.c:2716:ptlrpc_set_wait()) set ffff94163f9ce840 going to sleep for 11 seconds 00000100:00100000:2.0:1790736124.875499:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816068480 00000100:00100000:2.0:1790736124.875505:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816068480 00000100:00100000:2.0:1790736124.875595:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790736124.875604:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+11:7641:x1877722816068480:12345-0@lo:101: 00010000:00010000:2.0:1790736124.875617:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736124.875631:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941611931e00/0x6aae200528fe60e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe60df expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736124.875654:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941611931e00/0x6aae200528fe60e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe60df expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736124.875664:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941611931e00/0x6aae200528fe60e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe60df expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736124.875684:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611931e00, rc 0) 00000100:00100000:2.0:1790736124.875732:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+12:7641:x1877722816068480:12345-0@lo:101: Request processed in 129us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736124.875739:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790736124.875808:0:7641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:7641:1877722816068480:0@lo:101: 00010000:00010000:3.0:1790736124.875821:0:7641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff94162f8c8800/0x6aae200528fe60df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x6aae200528fe60e6 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736124.875831:0:7641:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff94162f8c8800/0x6aae200528fe60df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x6aae200528fe60e6 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736124.875956:0:7641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:7641:1877722816068608:0@lo:501: 00000100:00100000:3.0:1790736124.875984:0:7641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736124.876177:0:7641:0:(client.c:2716:ptlrpc_set_wait()) set ffff94163f9ce840 going to sleep for 11 seconds 00000100:00100000:1.0:1790736124.876267:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816068608 00000100:00100000:1.0:1790736124.876273:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816068608 00000100:00100000:0.0:1790736124.876390:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790736124.876402:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+12:7641:x1877722816068608:12345-0@lo:501: 00000100:00100000:0.0:1790736124.876645:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+12:7641:x1877722816068608:12345-0@lo:501: Request processed in 246us (659us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790736124.876653:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790736124.876826:0:7641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:7641:1877722816068608:0@lo:501: 10000000:01000000:3.0:1790736124.876841:0:7641:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.105@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790736124.876871:0:7641:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.105@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790736124.876877:0:7641:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c8800/0x6aae200528fe60df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x6aae200528fe60e6 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736124.876886:0:7641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c8800/0x6aae200528fe60df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x6aae200528fe60e6 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736124.876893:0:7641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.105@tcp lock: ffff94162f8c8800/0x6aae200528fe60df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x6aae200528fe60e6 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736124.876919:0:7641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790736124.876943:0:7641:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff94162d364800 10000000:01000000:3.0:1790736124.876948:0:7641:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790736124.876953:0:7641:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1790736124.876955:0:7641:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790736124.876959:0:7641:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1790736124.876962:0:7641:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1790736124.876981:0:7641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c9a00/0x6aae200528fe60ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736124.876988:0:7641:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff94162f8c9a00/0x6aae200528fe60ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736124.877006:0:7641:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff94162f8c9a00/0x6aae200528fe60ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736124.877021:0:7641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:7641:1877722816068736:0@lo:101: 00000100:00100000:3.0:1790736124.877051:0:7641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736124.877067:0:7641:0:(client.c:2716:ptlrpc_set_wait()) set ffff94163f9cec00 going to sleep for 11 seconds 00000100:00100000:3.0:1790736124.877081:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816068736 00000100:00100000:3.0:1790736124.877086:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816068736 00000100:00100000:3.0:1790736124.877124:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790736124.877130:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+12:7641:x1877722816068736:12345-0@lo:101: 00010000:00010000:3.0:1790736124.877137:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736124.877146:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94162f8c8600/0x6aae200528fe60f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe60ed expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736124.877164:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94162f8c8600/0x6aae200528fe60f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe60ed expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736124.877172:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94162f8c8600/0x6aae200528fe60f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe60ed expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736124.877179:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c8600, rc 0) 00000100:00100000:3.0:1790736124.877205:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+13:7641:x1877722816068736:12345-0@lo:101: Request processed in 74us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736124.877211:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790736124.877238:0:7641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:7641:1877722816068736:0@lo:101: 00010000:00010000:3.0:1790736124.877247:0:7641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff94162f8c9a00/0x6aae200528fe60ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe60f4 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736124.877264:0:7641:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff94162f8c9a00/0x6aae200528fe60ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe60f4 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736124.877438:0:7641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:7641:1877722816068864:0@lo:501: 00000100:00100000:3.0:1790736124.877462:0:7641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736124.877475:0:7641:0:(client.c:2716:ptlrpc_set_wait()) set ffff94163f9cec00 going to sleep for 11 seconds 00000100:00100000:3.0:1790736124.877487:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816068864 00000100:00100000:3.0:1790736124.877490:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816068864 00000100:00100000:3.0:1790736124.877505:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790736124.877509:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+13:7641:x1877722816068864:12345-0@lo:501: 00000100:00100000:3.0:1790736124.877670:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+13:7641:x1877722816068864:12345-0@lo:501: Request processed in 159us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736124.877675:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790736124.877701:0:7641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:7641:1877722816068864:0@lo:501: 00000100:00100000:3.0:1790736124.877722:0:7641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:7641:1877722816068992:0@lo:503: 00000100:00100000:3.0:1790736124.877757:0:7641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736124.877769:0:7641:0:(client.c:2716:ptlrpc_set_wait()) set ffff94163f9cec00 going to sleep for 11 seconds 00000100:00100000:3.0:1790736124.877780:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816068992 00000100:00100000:3.0:1790736124.877784:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816068992 00000100:00100000:3.0:1790736124.877800:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790736124.877805:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+13:7641:x1877722816068992:12345-0@lo:503: 00000100:00100000:3.0:1790736124.877940:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+13:7641:x1877722816068992:12345-0@lo:503: Request processed in 133us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736124.877947:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790736124.877981:0:7641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:7641:1877722816068992:0@lo:503: 00000040:00080000:3.0:1790736124.878253:0:7641:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790736124.878307:0:7641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:7641:1877722816069120:0@lo:502: 00010000:00010000:0.0:1790736124.878786:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790736124.878795:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff94162f8c8800/0x6aae200528fe60df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x6aae200528fe60e6 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736124.878805:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c8800 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:0.0:1790736124.878809:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff94162f8c8800/0x6aae200528fe60df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x6aae200528fe60e6 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736124.878834:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff94162f8c8800/0x6aae200528fe60df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x6aae200528fe60e6 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790736124.878841:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff94162f8c8800/0x6aae200528fe60df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x6aae200528fe60e6 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790736124.878847:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790736124.878871:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff94162f8c8800/0x6aae200528fe60df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6aae200528fe60e6 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736124.878878:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790736124.878900:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff94162f8c8800/0x6aae200528fe60df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6aae200528fe60e6 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736124.878907:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff94162f8c8800/0x6aae200528fe60df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6aae200528fe60e6 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736124.878920:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736124.878922:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736124.878923:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790736124.878934:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816069248:0@lo:103: 00000100:00100000:0.0:1790736124.878973:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736124.879029:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816069248 00000100:00100000:0.0:1790736124.879034:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816069248 00000100:00100000:0.0:1790736124.879068:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790736124.879075:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162ed92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52e04a2b-4e01-44b7-985c-7db034e22389+13:3306:x1877722816069248:12345-0@lo:103: 00010000:00010000:0.0:1790736124.879087:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790736124.879136:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941611931e00/0x6aae200528fe60e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6aae200528fe60df expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736124.879154:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790736124.879180:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162ed92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52e04a2b-4e01-44b7-985c-7db034e22389+12:3306:x1877722816069248:12345-0@lo:103: Request processed in 106us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736124.879186:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790736124.879224:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816069248:0@lo:103: 00000100:00100000:2.0:1790736124.879764:0:7641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736124.879834:0:7641:0:(client.c:2716:ptlrpc_set_wait()) set ffff94163f9cec00 going to sleep for 11 seconds 00000100:00100000:3.0:1790736124.879876:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816069120 00000100:00100000:3.0:1790736124.879881:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816069120 00000100:00100000:3.0:1790736124.879950:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790736124.879958:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+12:7641:x1877722816069120:12345-0@lo:502: 00000100:00100000:3.0:1790736124.880218:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+12:7641:x1877722816069120:12345-0@lo:502: Request processed in 260us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736124.880225:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790736124.880329:0:7641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:7641:1877722816069120:0@lo:502: 00000040:00080000:0.0:1790736124.880620:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1790736124.880666:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1790736124.880695:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1790736124.880733:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1790736124.880763:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1790736124.880789:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1790736124.880819:0:7641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed92680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:7641:1877722816069376:0@lo:502: 00000100:00100000:0.0:1790736124.880858:0:7641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736124.881400:0:7641:0:(client.c:2716:ptlrpc_set_wait()) set ffff941637e58240 going to sleep for 11 seconds 00000100:00100000:2.0:1790736124.881610:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816069376 00000100:00100000:2.0:1790736124.881618:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816069376 00000100:00100000:2.0:1790736124.881658:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790736124.881667:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+12:7641:x1877722816069376:12345-0@lo:502: 00000100:00100000:2.0:1790736124.881880:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+12:7641:x1877722816069376:12345-0@lo:502: Request processed in 213us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736124.881887:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790736124.881991:0:7641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed92680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:7641:1877722816069376:0@lo:502: 00000040:00080000:0.0:1790736124.882305:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1790736124.882332:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1790736124.882981:0:7648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790736124.882990:0:7648:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1790736124.882996:0:7648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790736124.882998:0:7648:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1790736124.883003:0:7648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790736124.883018:0:7648:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9416181e0000) 00000020:00000080:0.0:1790736124.883040:0:7648:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1790736124.883044:0:7648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790736124.883136:0:7648:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94162d364800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1790736124.883147:0:7648:0:(osd_handler.c:1577:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790736124.883153:0:7648:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6aae200528fe6102 00010000:00010000:0.0:1790736124.893692:0:7648:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1790736124.894048:0:7648:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1790736124.901722:0:7648:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1790736124.902024:0:7648:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1790736124.910284:0:7648:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1790736124.910886:0:7648:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1790736124.913540:0:7648:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1790736124.913551:0:7648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790736124.913558:0:7648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790736124.913560:0:7648:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1790736124.913563:0:7648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790736124.913567:0:7648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790736124.913568:0:7648:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790736124.913583:0:7648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790736124.913585:0:7648:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790736124.913663:0:7648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790736124.913668:0:7648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790736124.913669:0:7648:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790736124.913673:0:7648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1790736124.913986:0:7641:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1790736124.914012:0:7641:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1790736124.914038:0:7641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c9a00/0x6aae200528fe60ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe60f4 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736124.914052:0:7641:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff94162f8c9a00/0x6aae200528fe60ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe60f4 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790736124.914060:0:7641:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94162d364800 from 1 10000000:01000000:1.0:1790736124.914063:0:7641:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790736124.914125:0:7641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162156f600/0x6aae200528fe6109 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736124.914134:0:7641:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff94162156f600/0x6aae200528fe6109 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736124.914145:0:7641:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff94162156f600/0x6aae200528fe6109 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736124.914170:0:7641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:7641:1877722816069504:0@lo:101: 00000100:00100000:1.0:1790736124.914247:0:7641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736124.914300:0:7641:0:(client.c:2716:ptlrpc_set_wait()) set ffff941635cc2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790736124.916796:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816069504 00000100:00100000:2.0:1790736124.916823:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816069504 00000100:00100000:2.0:1790736124.916882:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790736124.916892:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+12:7641:x1877722816069504:12345-0@lo:101: 00010000:00010000:2.0:1790736124.916911:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736124.916929:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941611930600/0x6aae200528fe6110 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe6109 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736124.916956:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941611930600/0x6aae200528fe6110 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe6109 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736124.916968:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941611930600/0x6aae200528fe6110 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe6109 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736124.916977:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611930600, rc 0) 00000100:00100000:2.0:1790736124.917058:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+13:7641:x1877722816069504:12345-0@lo:101: Request processed in 168us (2811us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736124.917065:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790736124.917947:0:7641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:7641:1877722816069504:0@lo:101: 00010000:00010000:2.0:1790736124.917974:0:7641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff94162156f600/0x6aae200528fe6109 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6110 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736124.917986:0:7641:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff94162156f600/0x6aae200528fe6109 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe6110 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736124.918142:0:7641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:7641:1877722816069632:0@lo:501: 00000100:00100000:2.0:1790736124.918192:0:7641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736124.918233:0:7641:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416112e8540 going to sleep for 11 seconds 00000100:00100000:2.0:1790736124.918256:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816069632 00000100:00100000:2.0:1790736124.918262:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816069632 00000100:00100000:2.0:1790736124.918311:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790736124.918318:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+13:7641:x1877722816069632:12345-0@lo:501: 00000100:00100000:2.0:1790736124.921148:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+13:7641:x1877722816069632:12345-0@lo:501: Request processed in 2822us (2947us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736124.921162:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790736124.921321:0:7641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:7641:1877722816069632:0@lo:501: 00000100:00100000:2.0:1790736124.921376:0:7641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:7641:1877722816069760:0@lo:503: 00000100:00100000:2.0:1790736124.925504:0:7641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736124.925585:0:7641:0:(client.c:2716:ptlrpc_set_wait()) set ffff941633c42f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790736124.925619:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816069760 00000100:00100000:2.0:1790736124.925627:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816069760 00000100:00100000:2.0:1790736124.925676:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790736124.925684:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+13:7641:x1877722816069760:12345-0@lo:503: 00000100:00100000:2.0:1790736124.926057:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+13:7641:x1877722816069760:12345-0@lo:503: Request processed in 373us (4630us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736124.926066:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790736124.926143:0:7641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:7641:1877722816069760:0@lo:503: 00000040:00080000:2.0:1790736124.926415:0:7641:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790736124.932880:0:7641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:7641:1877722816069888:0@lo:502: 00000100:00100000:2.0:1790736124.932981:0:7641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736124.937597:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816069888 00000100:00100000:0.0:1790736124.937615:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816069888 00000100:00100000:0.0:1790736124.937686:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1790736124.937696:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+13:7641:x1877722816069888:12345-0@lo:502: 00000100:00100000:0.0:1790736124.937994:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+13:7641:x1877722816069888:12345-0@lo:502: Request processed in 299us (5013us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736124.938002:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790736124.939713:0:7641:0:(client.c:2716:ptlrpc_set_wait()) set ffff941633c42f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790736124.939748:0:7641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:7641:1877722816069888:0@lo:502: 00000040:00080000:2.0:1790736124.940114:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1790736124.940182:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1790736124.940225:0:7641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:7641:1877722816070016:0@lo:502: 00000100:00100000:2.0:1790736124.940307:0:7641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736124.940343:0:7641:0:(client.c:2716:ptlrpc_set_wait()) set ffff941633c42f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790736124.940399:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816070016 00000100:00100000:3.0:1790736124.940407:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816070016 00000100:00100000:3.0:1790736124.940463:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790736124.940472:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+13:7641:x1877722816070016:12345-0@lo:502: 00000100:00100000:3.0:1790736124.940694:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+13:7641:x1877722816070016:12345-0@lo:502: Request processed in 221us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736124.940702:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1790736124.941160:0:7641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:7641:1877722816070016:0@lo:502: 00000040:00080000:0.0:1790736124.941271:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1790736124.941285:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1790736124.944215:0:7652:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790736124.944227:0:7652:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790736124.944230:0:7652:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790736124.944235:0:7652:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94162d364800 00000020:00000080:2.0:1790736124.944238:0:7652:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790736124.944259:0:7652:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790736124.944263:0:7652:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790736124.944265:0:7652:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1790736124.944269:0:7652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1790736124.944404:0:7641:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1790736124.944434:0:7641:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790736124.944455:0:7641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162156f600/0x6aae200528fe6109 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6110 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736124.944466:0:7641:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff94162156f600/0x6aae200528fe6109 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6110 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790736124.944503:0:7641:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790736124.944506:0:7641:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff94162d364800 10000000:01000000:3.0:1790736124.944509:0:7641:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff94162d364800 10000000:01000000:3.0:1790736124.944513:0:7641:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790736124.944525:0:7641:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94162d364800 from 1 10000000:01000000:3.0:1790736124.944527:0:7641:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790736124.944563:0:7641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c8000/0x6aae200528fe6117 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736124.944583:0:7641:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff94162f8c8000/0x6aae200528fe6117 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736124.944594:0:7641:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff94162f8c8000/0x6aae200528fe6117 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736124.944617:0:7641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:7641:1877722816070144:0@lo:101: 00000100:00100000:3.0:1790736124.944688:0:7641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736124.944730:0:7641:0:(client.c:2716:ptlrpc_set_wait()) set ffff94163f9ce840 going to sleep for 11 seconds 00000100:00100000:0.0:1790736124.946270:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816070144 00000100:00100000:0.0:1790736124.946284:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816070144 00000100:00100000:0.0:1790736124.946582:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1790736124.946595:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+13:7641:x1877722816070144:12345-0@lo:101: 00010000:00010000:0.0:1790736124.946612:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736124.946630:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941600030600/0x6aae200528fe611e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe6117 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736124.946656:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941600030600/0x6aae200528fe611e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe6117 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736124.946667:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941600030600/0x6aae200528fe611e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe6117 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736124.946692:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941600030600, rc 0) 00000100:00100000:0.0:1790736124.946769:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+14:7641:x1877722816070144:12345-0@lo:101: Request processed in 178us (2081us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736124.946775:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1790736124.946854:0:7641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:7641:1877722816070144:0@lo:101: 00010000:00010000:2.0:1790736124.946872:0:7641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff94162f8c8000/0x6aae200528fe6117 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe611e expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736124.946881:0:7641:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff94162f8c8000/0x6aae200528fe6117 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe611e expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736124.946996:0:7641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:7641:1877722816070272:0@lo:501: 00000100:00100000:2.0:1790736124.947030:0:7641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736124.948401:0:7641:0:(client.c:2716:ptlrpc_set_wait()) set ffff941633c429c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790736124.948750:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816070272 00000100:00100000:3.0:1790736124.948760:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816070272 00000100:00100000:3.0:1790736124.948804:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1790736124.948814:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+14:7641:x1877722816070272:12345-0@lo:501: 00000100:00100000:3.0:1790736124.949140:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+14:7641:x1877722816070272:12345-0@lo:501: Request processed in 327us (2108us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736124.949148:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790736124.949253:0:7641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:7641:1877722816070272:0@lo:501: 00000100:00100000:2.0:1790736124.949301:0:7641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:7641:1877722816070400:0@lo:503: 00000100:00100000:2.0:1790736124.949455:0:7641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736124.949478:0:7641:0:(client.c:2716:ptlrpc_set_wait()) set ffff941633c429c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790736124.949581:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816070400 00000100:00100000:3.0:1790736124.949586:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816070400 00000100:00100000:3.0:1790736124.949606:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790736124.949612:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+14:7641:x1877722816070400:12345-0@lo:503: 00000100:00100000:3.0:1790736124.949761:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+14:7641:x1877722816070400:12345-0@lo:503: Request processed in 149us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736124.949768:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1790736124.949834:0:7641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:7641:1877722816070400:0@lo:503: 00000040:00080000:2.0:1790736124.950181:0:7641:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790736124.950236:0:7641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:7641:1877722816070528:0@lo:502: 00000100:00100000:2.0:1790736124.950275:0:7641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736124.950446:0:7641:0:(client.c:2716:ptlrpc_set_wait()) set ffff941633c429c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790736124.950700:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816070528 00000100:00100000:0.0:1790736124.950706:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816070528 00000100:00100000:3.0:1790736124.950753:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790736124.950767:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+14:7641:x1877722816070528:12345-0@lo:502: 00000100:00100000:3.0:1790736124.950960:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+14:7641:x1877722816070528:12345-0@lo:502: Request processed in 194us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736124.950967:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790736124.951051:0:7641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:7641:1877722816070528:0@lo:502: 00000040:00080000:2.0:1790736124.951908:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1790736124.951973:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1790736124.952001:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1790736124.952042:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1790736124.952071:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1790736124.952523:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1790736124.952582:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1790736124.952616:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1790736124.952655:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1790736124.952706:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1790736124.952736:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1790736124.952775:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1790736124.952963:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1790736124.952999:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1790736124.953042:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1790736124.953074:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1790736124.953332:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1790736124.953382:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1790736124.953417:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1790736124.953530:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1790736124.953594:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1790736124.953627:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1790736124.953654:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1790736124.953693:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1790736124.953721:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1790736124.953747:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1790736124.953805:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1790736124.953841:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1790736124.953875:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1790736124.953916:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1790736124.953944:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1790736124.953970:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1790736124.954006:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1790736124.954045:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1790736124.954076:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1790736124.954149:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1790736124.954180:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1790736124.954220:0:7641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:7641:1877722816070656:0@lo:502: 00000100:00100000:3.0:1790736124.954291:0:7641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736124.954325:0:7641:0:(client.c:2716:ptlrpc_set_wait()) set ffff94163f9ced80 going to sleep for 11 seconds 00000100:00100000:1.0:1790736124.954467:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816070656 00000100:00100000:1.0:1790736124.954474:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816070656 00000100:00100000:1.0:1790736124.954516:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1790736124.954525:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+14:7641:x1877722816070656:12345-0@lo:502: 00000100:00100000:1.0:1790736124.954737:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+14:7641:x1877722816070656:12345-0@lo:502: Request processed in 212us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736124.954745:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1790736124.954910:0:7641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:7641:1877722816070656:0@lo:502: 00000040:00080000:3.0:1790736124.954982:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1790736124.954993:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1790736124.955884:0:7653:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1790736124.955912:0:7653:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff94163b29b380) 00000020:00000080:1.0:1790736124.955933:0:7653:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1790736124.956008:0:7653:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94162d364800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790736124.956012:0:7653:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94162d364800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790736124.956015:0:7653:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94162d364800 3 00010000:00080000:1.0:1790736124.956042:0:7653:0:(ldlm_lib.c:102:import_set_conn()) imp ffff941633c50800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.105@tcp at head 00010000:00010000:0.0:1790736124.958374:0:7653:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1790736124.958694:0:7653:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1790736124.958734:0:7653:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790736124.958745:0:7653:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x6aae200528fe612c 00000100:00080000:0.0:1790736124.958754:0:7653:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790736124.958766:0:7653:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff941633c50800 using connection 192.168.203.105@tcp/0@lo 00000100:00100000:0.0:1790736124.958804:0:7653:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94162ed92680 x1877722816070784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790736124.958837:0:7653:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1790736124.959019:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1877722816070784:0@lo:38: 00000100:00100000:2.0:1790736124.959088:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736124.959231:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816070784 00000100:00100000:0.0:1790736124.959239:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816070784 00000100:00100000:0.0:1790736124.959306:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790736124.959314:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1877722816070784:12345-0@lo:38: 00010000:00080000:0.0:1790736124.959338:0:5845:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 196 last 0 00000020:00000080:0.0:1790736124.959369:0:5845:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x6aae200528fe6133 00000004:00100000:0.0:1790736124.959383:0:5845:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790736124.959414:0:5845:0:(import.c:65:import_set_state_nolock()) ffff94162f89b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790736124.959480:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877722816070784:12345-0@lo:38: Request processed in 165us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736124.959487:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790736124.959707:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877722816070912:0@lo:400: 00000100:00100000:3.0:1790736124.959735:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736124.961809:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1877722816071040:0@lo:400: 00000100:00100000:3.0:1790736124.961869:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736124.961928:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816070912 00000100:00100000:2.0:1790736124.961937:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816070912 00000100:00100000:2.0:1790736124.961980:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790736124.961990:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160838ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877722816070912:12345-0@lo:400: 00000100:00100000:2.0:1790736124.962049:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160838ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877722816070912:12345-0@lo:400: Request processed in 60us (2312us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736124.962057:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1790736124.962117:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94162ed92680 x1877722816070784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790736134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790736124.962128:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790736124.962138:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1790736124.962145:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790736124.962149:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790736124.962152:0:3305:0:(import.c:65:import_set_state_nolock()) ffff941633c50800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790736124.962159:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1877722816070784:0@lo:38: 00000100:00100000:3.0:1790736124.962600:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790736124.962608:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816071168:0@lo:400: 00000100:00100000:3.0:1790736124.962637:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1790736124.962685:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94160838c000 x1877722816070912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790736140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736124.962696:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877722816070912:0@lo:400: 00000100:00100000:3.0:1790736124.962729:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816071040 00000100:00100000:3.0:1790736124.962733:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816071040 00000100:00100000:3.0:1790736124.962764:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790736124.962770:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160838f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877722816071040:12345-0@lo:400: 00000100:00100000:3.0:1790736124.962907:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160838f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877722816071040:12345-0@lo:400: Request processed in 136us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736124.962931:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1790736124.962951:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790736124.962969:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94160838ca80 x1877722816071040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790736140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736124.962979:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1877722816071040:0@lo:400: 00000040:00080000:3.0:1790736124.963159:0:7653:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1790736124.963206:0:7641:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1790736124.963231:0:7641:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790736124.963243:0:7641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c8000/0x6aae200528fe6117 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe611e expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736124.963253:0:7641:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff94162f8c8000/0x6aae200528fe6117 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe611e expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790736124.963292:0:7641:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790736124.963294:0:7641:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790736124.963295:0:7641:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790736124.963296:0:7641:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790736124.963297:0:7641:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790736124.963299:0:7641:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790736124.963300:0:7641:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790736124.963301:0:7641:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790736124.963303:0:7641:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790736124.963305:0:7641:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790736124.963306:0:7641:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790736124.963309:0:7641:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1790736124.963312:0:7641:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790736124.963313:0:7641:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790736124.963315:0:7641:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790736124.963315:0:7641:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790736124.963316:0:7641:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790736124.963318:0:7641:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790736124.963319:0:7641:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790736124.963324:0:7641:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790736124.963325:0:7641:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790736124.963326:0:7641:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790736124.963327:0:7641:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790736124.963344:0:7641:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1790736124.963355:0:7641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:7641:1877722816071296:0@lo:253: 00000100:00100000:3.0:1790736124.963388:0:7641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736124.963417:0:7641:0:(client.c:2716:ptlrpc_set_wait()) set ffff94163f9cef00 going to sleep for 11 seconds 00000100:00100000:0.0:1790736124.963598:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816071168 00000100:00100000:0.0:1790736124.963604:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816071168 00000100:00100000:3.0:1790736124.963710:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816071296 00000100:00100000:3.0:1790736124.963715:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816071296 00000100:00100000:3.0:1790736124.963749:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1790736124.963756:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+14:7641:x1877722816071296:12345-0@lo:253: 20000000:01000000:3.0:1790736124.963790:0:5837:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1790736124.963804:0:5837:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1790736124.964307:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790736124.964315:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160838dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816071168:12345-0@lo:400: 00000100:00080000:3.0:1790736124.964535:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790736124.966303:0:7654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838c000 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7654:1877722816071424:0@lo:901: 00000100:00100000:3.0:1790736124.966377:0:7654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736124.966424:0:5854:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816071424 00000100:00100000:0.0:1790736124.966565:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160838dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816071168:12345-0@lo:400: Request processed in 2249us (3924us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736124.966587:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790736124.966738:0:5854:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816071424 00000100:00100000:3.0:1790736124.966786:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790736124.966794:0:5854:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160838ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7654:x1877722816071424:12345-0@lo:901: 00000100:00100000:3.0:1790736124.967166:0:5854:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160838ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7654:x1877722816071424:12345-0@lo:901: Request processed in 372us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736124.967173:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1790736124.967195:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790736124.967291:0:7654:0:(client.c:2716:ptlrpc_set_wait()) set ffff94163f9ce480 going to sleep for 11 seconds 00010000:00080000:3.0:1790736124.967318:0:7654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94160838c000 x1877722816071424/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1790736140 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736124.967333:0:7654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838c000 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7654:1877722816071424:0@lo:901: 00010000:00080000:1.0:1790736124.970743:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94160838e680 x1877722816071168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736124.970761:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816071168:0@lo:400: 20000000:01000000:2.0:1790736125.029045:0:5837:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790736125.029085:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1790736125.033718:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+14:7641:x1877722816071296:12345-0@lo:253: Request processed in 69955us (70321us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736125.033731:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1790736125.033822:0:7641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52e04a2b-4e01-44b7-985c-7db034e22389:7641:1877722816071296:0@lo:253: 10000000:01000000:3.0:1790736125.033838:0:7641:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1790736125.033841:0:7641:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790736125.033843:0:7641:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790736125.033845:0:7641:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790736125.033846:0:7641:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790736125.033847:0:7641:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790736125.033848:0:7641:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790736125.033850:0:7641:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790736125.033851:0:7641:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790736125.033853:0:7641:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790736125.033854:0:7641:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790736125.033855:0:7641:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1790736125.033869:0:7641:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1790736125.038818:0:5859:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790736125.038828:0:5859:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790736125.038857:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff941600030400/0x6aae200528fe613a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736125.038877:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff941642172200/0x6aae200528fe608b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe6084 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736125.038887:0:5859:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff941600030400/0x6aae200528fe613a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736125.038928:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff941642172200/0x6aae200528fe608b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6aae200528fe6084 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736125.038945:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff941642172200/0x6aae200528fe608b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6aae200528fe6084 expref: 13 pid: 5837 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736125.038958:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed91880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1877722816071552:0@lo:104: 00000100:00100000:0.0:1790736125.039034:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736125.039165:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162d152b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790736125.044589:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816071552 00000100:00100000:1.0:1790736125.044609:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816071552 00000100:00100000:2.0:1790736125.048120:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790736125.048133:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162ed93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:52e04a2b-4e01-44b7-985c-7db034e22389+3:5859:x1877722816071552:12345-0@lo:104: 00010000:00010000:2.0:1790736125.048151:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe6084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe608b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736125.048253:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790736125.048260:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162ed93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:52e04a2b-4e01-44b7-985c-7db034e22389+3:5859:x1877722816071552:12345-0@lo:104: Request processed in 131us (9226us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736125.048266:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1790736125.048289:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790736125.048294:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe6084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe608b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736125.048302:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941600030200 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:2.0:1790736125.048306:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe6084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6aae200528fe608b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736125.048327:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe6084 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6aae200528fe608b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790736125.048335:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe6084 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6aae200528fe608b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790736125.048341:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790736125.048374:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe6084 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe608b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736125.048397:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790736125.048415:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe6084 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe608b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736125.048422:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe6084 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe608b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736125.048563:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736125.048565:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736125.048567:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736125.048672:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed91880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1877722816071552:0@lo:104: 00010000:00010000:1.0:1790736125.048696:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff941600030400/0x6aae200528fe613a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736125.049026:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816071680:0@lo:103: 00000100:00100000:3.0:1790736125.049071:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736125.049561:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816071680 00000100:00100000:1.0:1790736125.049583:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816071680 00010000:00010000:1.0:1790736125.049610:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff941642172200/0x6aae200528fe608b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe6084 expref: 14 pid: 5837 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736125.049659:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790736125.049667:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416055c9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52e04a2b-4e01-44b7-985c-7db034e22389+14:3306:x1877722816071680:12345-0@lo:103: 00010000:00010000:1.0:1790736125.049680:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736125.049684:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff941642172200/0x6aae200528fe608b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe6084 expref: 14 pid: 5837 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736125.049695:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff941642172200/0x6aae200528fe608b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6aae200528fe6084 expref: 14 pid: 5837 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736125.049710:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941642172200/0x6aae200528fe608b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6aae200528fe6084 expref: 14 pid: 5837 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736125.049726:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff941600030400/0x6aae200528fe613a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736125.049733:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941600030400/0x6aae200528fe613a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790736125.049749:0:5830:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010921930s 00010000:00010000:1.0:1790736125.049753:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff941600030400/0x6aae200528fe613a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736125.049761:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff941600030400/0x6aae200528fe613a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736125.049769:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff941600030400/0x6aae200528fe613a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736125.049776:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff941600030400/0x6aae200528fe613a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736125.049787:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941600030400 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:1.0:1790736125.049791:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff941600030400/0x6aae200528fe613a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736125.049799:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff941600030400/0x6aae200528fe613a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736125.049891:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff941600030400/0x6aae200528fe613a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736125.049903:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790736125.049940:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416055c9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52e04a2b-4e01-44b7-985c-7db034e22389+13:3306:x1877722816071680:12345-0@lo:103: Request processed in 274us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736125.049946:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790736125.050050:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816071680:0@lo:103: 00010000:00010000:3.0:1790736125.050072:0:5859:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff941600030400/0x6aae200528fe613a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736125.050080:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff941600030400/0x6aae200528fe613a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736125.050086:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941600030400/0x6aae200528fe613a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1790736125.051322:0:7641:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1790736125.051686:0:7641:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1790736125.051998:0:7641:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1790736125.053032:0:7641:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1790736125.054089:0:7641:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1790736125.054637:0:7641:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1790736125.055670:0:7641:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1790736125.085266:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816071808:0@lo:13: 00000100:00100000:3.0:1790736125.085361:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736125.085448:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816071808 00000100:00100000:3.0:1790736125.085457:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816071808 00000100:00100000:3.0:1790736125.085501:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790736125.085518:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160838ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816071808:12345-0@lo:13: 00002000:00000024:3.0:1790736125.085554:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790736125.085608:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160838ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816071808:12345-0@lo:13: Request processed in 90us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736125.085615:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1790736125.087555:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94162ed93480 x1877722816071808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736141 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736125.087596:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816071808:0@lo:13: 00002000:00080000:2.0:1790736125.323444:0:7641:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1790736125.323453:0:7641:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1790736125.323488:0:7641:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790736125.327733:0:7641:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.105@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790736125.327760:0:7641:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1790736125.327794:0:7641:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1790736125.717370:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736126.750389:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736127.769263:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736128.808947:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736129.813302:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736130.197734:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816071936:0@lo:400: 00000100:00100000:1.0:1790736130.197841:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736130.197900:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1877722816072448:0@lo:400: 00000100:00100000:3.0:1790736130.198044:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877722816072064:0@lo:400: 00000100:00100000:1.0:1790736130.198148:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736130.198216:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816072320:0@lo:400: 00000100:00100000:0.0:1790736130.198313:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816071936 00000100:00100000:0.0:1790736130.198324:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816071936 00000100:00100000:0.0:1790736130.198409:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790736130.198430:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+13:3308:x1877722816071936:12345-0@lo:400: 00000100:00100000:1.0:1790736130.204653:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790736130.204678:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816072576:0@lo:13: 00000100:00100000:1.0:1790736130.204769:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736130.205038:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1877722816072192:0@lo:400: 00000100:00100000:1.0:1790736130.205071:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736130.205143:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816072448 00000100:00100000:1.0:1790736130.205163:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816072448 00000100:00100000:1.0:1790736130.205225:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816072192 00000100:00100000:1.0:1790736130.205227:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816072192 00000100:00100000:1.0:1790736130.205247:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790736130.205256:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877722816072448:12345-0@lo:400: 00000100:00100000:1.0:1790736130.205319:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877722816072448:12345-0@lo:400: Request processed in 65us (7174us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736130.205326:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790736130.205345:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790736130.205350:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877722816072192:12345-0@lo:400: 00000100:00100000:1.0:1790736130.205377:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877722816072192:12345-0@lo:400: Request processed in 27us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736130.205383:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1790736130.205574:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790736130.205616:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163fae2a00 x1877722816072192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790736146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736130.205632:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1877722816072192:0@lo:400: 00010000:00080000:1.0:1790736130.205676:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163fae2d80 x1877722816072448/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790736146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736130.205684:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1877722816072448:0@lo:400: 00000100:00100000:0.0:1790736130.205855:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+13:3308:x1877722816071936:12345-0@lo:400: Request processed in 7435us (8013us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736130.205867:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1790736130.206223:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816071936:0@lo:400: 00000100:00100000:3.0:1790736130.206896:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816072576 00000100:00100000:3.0:1790736130.206910:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816072576 00000100:00100000:3.0:1790736130.206992:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790736130.207012:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816072576:12345-0@lo:13: 00002000:00000024:3.0:1790736130.207049:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790736130.207154:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816072576:12345-0@lo:13: Request processed in 154us (2386us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736130.207161:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790736130.207200:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790736130.207690:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790736130.207716:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816072064 00000100:00100000:1.0:1790736130.207724:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816072064 00000100:00100000:1.0:1790736130.207922:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790736130.207936:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160838c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877722816072064:12345-0@lo:400: 00000100:00100000:1.0:1790736130.208024:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160838c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877722816072064:12345-0@lo:400: Request processed in 92us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736130.208270:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1790736130.211426:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163fae0380 x1877722816072064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790736146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736130.211444:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877722816072064:0@lo:400: 00010000:00080000:3.0:1790736130.211505:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94162ed91c00 x1877722816072576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736146 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736130.211525:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816072576:0@lo:13: 00000100:00100000:3.0:1790736130.215211:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816072320 00000100:00100000:3.0:1790736130.215225:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816072320 00000100:00100000:3.0:1790736130.215304:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790736130.215316:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160838f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816072320:12345-0@lo:400: 00000100:00100000:3.0:1790736130.215409:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160838f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816072320:12345-0@lo:400: Request processed in 95us (7141us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736130.215415:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1790736130.215461:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163fae3800 x1877722816072320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736130.215474:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816072320:0@lo:400: 00000100:00100000:1.0:1790736130.216199:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:3.0:1790736130.845402:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790736131.226765:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790736131.226774:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94162d353800 from 30 10000000:01000000:3.0:1790736131.226780:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790736131.226838:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c8e00/0x6aae200528fe6141 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736131.226850:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff94162f8c8e00/0x6aae200528fe6141 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736131.226864:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff94162f8c8e00/0x6aae200528fe6141 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736131.226896:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816072704:0@lo:101: 00000100:00100000:3.0:1790736131.226997:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736131.227064:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941633e94e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790736131.227172:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816072704 00000100:00100000:0.0:1790736131.227182:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816072704 00000100:00100000:0.0:1790736131.227242:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790736131.227253:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+13:5841:x1877722816072704:12345-0@lo:101: 00010000:00010000:0.0:1790736131.227271:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736131.227285:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941600030400/0x6aae200528fe6148 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe6141 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736131.227314:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941600030400/0x6aae200528fe6148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe6141 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736131.227327:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941600030400/0x6aae200528fe6148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe6141 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736131.227338:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941600030400, rc 0) 00000100:00100000:0.0:1790736131.227384:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+14:5841:x1877722816072704:12345-0@lo:101: Request processed in 133us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736131.227391:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1790736131.228828:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816072704:0@lo:101: 00010000:00010000:3.0:1790736131.228875:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff94162f8c8e00/0x6aae200528fe6141 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6148 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736131.228889:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff94162f8c8e00/0x6aae200528fe6141 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe6148 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736131.228995:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816072832:0@lo:501: 00000100:00100000:3.0:1790736131.229055:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736131.229147:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941633e94e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790736131.229459:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816072832 00000100:00100000:0.0:1790736131.229468:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816072832 00000100:00100000:0.0:1790736131.229511:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790736131.229520:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+14:5841:x1877722816072832:12345-0@lo:501: 00000100:00100000:0.0:1790736131.230002:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+14:5841:x1877722816072832:12345-0@lo:501: Request processed in 481us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736131.230018:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790736131.230298:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816072832:0@lo:501: 00000100:00100000:3.0:1790736131.230343:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816072960:0@lo:503: 00000100:00100000:3.0:1790736131.230389:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736131.230564:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941633e94e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790736131.230632:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816072960 00000100:00100000:2.0:1790736131.230639:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816072960 00000100:00100000:2.0:1790736131.230681:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1790736131.230690:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+14:5841:x1877722816072960:12345-0@lo:503: 00000100:00100000:2.0:1790736131.231029:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+14:5841:x1877722816072960:12345-0@lo:503: Request processed in 339us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736131.231038:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790736131.231577:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816072960:0@lo:503: 00000100:00100000:3.0:1790736131.232059:0:7904:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:7904:1877722816073088:0@lo:502: 00000100:00100000:2.0:1790736131.235796:0:7904:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736131.235878:0:7904:0:(client.c:2716:ptlrpc_set_wait()) set ffff941633e94180 going to sleep for 11 seconds 00000100:00100000:0.0:1790736131.241116:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816073088 00000100:00100000:0.0:1790736131.241140:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816073088 00000100:00100000:0.0:1790736131.241223:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1790736131.241236:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606656850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+14:7904:x1877722816073088:12345-0@lo:502: 00000100:00100000:0.0:1790736131.241765:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606656850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+14:7904:x1877722816073088:12345-0@lo:502: Request processed in 530us (5979us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736131.241775:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790736131.242035:0:7904:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:7904:1877722816073088:0@lo:502: 00000100:00100000:2.0:1790736131.242158:0:7904:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063ad180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:7904:1877722816073216:0@lo:502: 00000100:00100000:2.0:1790736131.242220:0:7904:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736131.242262:0:7904:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162f7d7180 going to sleep for 11 seconds 00000100:00100000:0.0:1790736131.242329:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816073216 00000100:00100000:0.0:1790736131.242336:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816073216 00000100:00100000:0.0:1790736131.242376:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790736131.242385:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606657c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+14:7904:x1877722816073216:12345-0@lo:502: 00000100:00100000:0.0:1790736131.242594:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606657c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+14:7904:x1877722816073216:12345-0@lo:502: Request processed in 210us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736131.242601:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1790736131.242880:0:7904:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063ad180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:7904:1877722816073216:0@lo:502: 00000040:00080000:2.0:1790736131.242902:0:7904:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1790736131.243128:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1790736131.243156:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790736131.243169:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c8e00/0x6aae200528fe6141 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6148 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736131.243183:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff94162f8c8e00/0x6aae200528fe6141 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6148 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790736131.243194:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1790736131.243198:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1790736131.243201:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1790736131.243233:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe614f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736131.243255:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe614f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736131.243267:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe614f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736131.243284:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed93100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816073344:0@lo:101: 00000100:00100000:0.0:1790736131.243319:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736131.243346:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611973600 going to sleep for 11 seconds 00000100:00100000:2.0:1790736131.243444:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816073344 00000100:00100000:2.0:1790736131.243450:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816073344 00000100:00100000:2.0:1790736131.243483:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1790736131.243491:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606654c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+14:5841:x1877722816073344:12345-0@lo:101: 00010000:00010000:2.0:1790736131.243503:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736131.243517:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941611930e00/0x6aae200528fe6156 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe614f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736131.243556:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941611930e00/0x6aae200528fe6156 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe614f expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736131.243568:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941611930e00/0x6aae200528fe6156 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe614f expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736131.243577:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611930e00, rc 0) 00000100:00100000:2.0:1790736131.243611:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606654c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+15:5841:x1877722816073344:12345-0@lo:101: Request processed in 121us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736131.243618:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1790736131.243652:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed93100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816073344:0@lo:101: 00010000:00010000:2.0:1790736131.243665:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe614f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6156 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736131.243681:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe614f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe6156 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736131.243729:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063ad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816073472:0@lo:501: 00000100:00100000:2.0:1790736131.243754:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736131.243766:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162f7d7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790736131.243779:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816073472 00000100:00100000:2.0:1790736131.243782:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816073472 00000100:00100000:2.0:1790736131.243801:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790736131.243807:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606657050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+15:5841:x1877722816073472:12345-0@lo:501: 00000100:00100000:2.0:1790736131.244068:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606657050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+15:5841:x1877722816073472:12345-0@lo:501: Request processed in 260us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736131.244075:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790736131.244126:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063ad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816073472:0@lo:501: 00000100:00100000:2.0:1790736131.244154:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063ad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816073600:0@lo:503: 00000100:00100000:2.0:1790736131.244190:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736131.244203:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162f7d7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790736131.244215:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816073600 00000100:00100000:2.0:1790736131.244218:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816073600 00000100:00100000:2.0:1790736131.244238:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790736131.244243:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606657850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+15:5841:x1877722816073600:12345-0@lo:503: 00000100:00100000:2.0:1790736131.244559:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606657850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+15:5841:x1877722816073600:12345-0@lo:503: Request processed in 314us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736131.244566:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790736131.244606:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063ad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816073600:0@lo:503: 00000100:00100000:0.0:1790736131.256079:0:7905:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed93800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:7905:1877722816073728:0@lo:502: 00000100:00100000:0.0:1790736131.256210:0:7905:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736131.256267:0:7905:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611973600 going to sleep for 11 seconds 00000100:00100000:2.0:1790736131.256385:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816073728 00000100:00100000:2.0:1790736131.256395:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816073728 00000100:00100000:2.0:1790736131.256461:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790736131.256471:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+15:7905:x1877722816073728:12345-0@lo:502: 00000100:00100000:2.0:1790736131.256790:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+15:7905:x1877722816073728:12345-0@lo:502: Request processed in 321us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736131.256799:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1790736131.257020:0:7905:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed93800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:7905:1877722816073728:0@lo:502: 00000020:01000000:0.0:1790736131.257056:0:7905:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790736131.257067:0:7905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790736131.257069:0:7905:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790736131.257075:0:7905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790736131.257077:0:7905:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1790736131.257134:0:7905:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed93800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:7905:1877722816073856:0@lo:502: 00000100:00100000:0.0:1790736131.257172:0:7905:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736131.257204:0:7905:0:(client.c:2716:ptlrpc_set_wait()) set ffff941637f1ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1790736131.258242:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816073856 00000100:00100000:2.0:1790736131.258254:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816073856 00000100:00100000:2.0:1790736131.258315:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790736131.258325:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606654050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+15:7905:x1877722816073856:12345-0@lo:502: 00000100:00100000:2.0:1790736131.258765:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606654050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+15:7905:x1877722816073856:12345-0@lo:502: Request processed in 440us (1591us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736131.258774:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1790736131.258872:0:7905:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed93800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:7905:1877722816073856:0@lo:502: 00000020:01000000:0.0:1790736131.258903:0:7905:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790736131.258910:0:7905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790736131.258912:0:7905:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1790736131.258917:0:7905:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1790736131.260204:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1790736131.260236:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1790736131.260251:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe614f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6156 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736131.260268:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe614f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6156 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790736131.260280:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790736131.260283:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff941604c0d800 from 30 10000000:01000000:2.0:1790736131.260287:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790736131.260338:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff941611930800/0x6aae200528fe615d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736131.260348:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff941611930800/0x6aae200528fe615d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736131.260368:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff941611930800/0x6aae200528fe615d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736131.260394:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063ad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816073984:0@lo:101: 00000100:00100000:2.0:1790736131.260564:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736131.260618:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162f7d7900 going to sleep for 11 seconds 00000100:00100000:0.0:1790736131.260669:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816073984 00000100:00100000:0.0:1790736131.260683:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816073984 00000100:00100000:0.0:1790736131.260732:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790736131.260741:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606654450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+15:5841:x1877722816073984:12345-0@lo:101: 00010000:00010000:0.0:1790736131.260757:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736131.260771:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941600030800/0x6aae200528fe6164 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe615d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736131.260800:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941600030800/0x6aae200528fe6164 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe615d expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736131.260811:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941600030800/0x6aae200528fe6164 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe615d expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736131.260821:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941600030800, rc 0) 00000100:00100000:0.0:1790736131.260871:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606654450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+16:5841:x1877722816073984:12345-0@lo:101: Request processed in 131us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736131.260878:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1790736131.260987:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063ad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816073984:0@lo:101: 00010000:00010000:3.0:1790736131.261002:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff941611930800/0x6aae200528fe615d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6164 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736131.261012:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff941611930800/0x6aae200528fe615d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe6164 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736131.261070:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816074112:0@lo:501: 00000100:00100000:3.0:1790736131.261361:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736131.261600:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816074112 00000100:00100000:0.0:1790736131.261607:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816074112 00000100:00100000:0.0:1790736131.261645:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1790736131.261654:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606655050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+16:5841:x1877722816074112:12345-0@lo:501: 00000100:00100000:0.0:1790736131.261959:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606655050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+16:5841:x1877722816074112:12345-0@lo:501: Request processed in 305us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736131.261967:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790736131.268740:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162a6b9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790736131.268812:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816074112:0@lo:501: 00000100:00100000:2.0:1790736131.268902:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816074240:0@lo:503: 00000100:00100000:2.0:1790736131.269006:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736131.269037:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162f7d7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790736131.269218:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816074240 00000100:00100000:0.0:1790736131.269229:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816074240 00000100:00100000:0.0:1790736131.269290:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1790736131.269300:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606655c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+16:5841:x1877722816074240:12345-0@lo:503: 00000100:00100000:0.0:1790736131.269585:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606655c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+16:5841:x1877722816074240:12345-0@lo:503: Request processed in 285us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736131.269600:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1790736131.269771:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816074240:0@lo:503: 00000100:00100000:3.0:1790736131.270210:0:7906:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:7906:1877722816074368:0@lo:502: 00000100:00100000:3.0:1790736131.270251:0:7906:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736131.270284:0:7906:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162a6b90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790736131.270365:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816074368 00000100:00100000:0.0:1790736131.270372:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816074368 00000100:00100000:0.0:1790736131.270400:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790736131.270567:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606655850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+16:7906:x1877722816074368:12345-0@lo:502: 00000100:00100000:0.0:1790736131.270802:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606655850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+16:7906:x1877722816074368:12345-0@lo:502: Request processed in 392us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736131.270809:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1790736131.270889:0:7906:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:7906:1877722816074368:0@lo:502: 00000100:00100000:3.0:1790736131.270935:0:7906:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:7906:1877722816074496:0@lo:502: 00000100:00100000:3.0:1790736131.270965:0:7906:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736131.270986:0:7906:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162a6b90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790736131.271289:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816074496 00000100:00100000:0.0:1790736131.271296:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816074496 00000100:00100000:0.0:1790736131.271378:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1790736131.271388:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606654850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+16:7906:x1877722816074496:12345-0@lo:502: 00000100:00100000:0.0:1790736131.271577:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606654850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+16:7906:x1877722816074496:12345-0@lo:502: Request processed in 190us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736131.271584:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790736131.277193:0:7906:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:7906:1877722816074496:0@lo:502: 00000040:00080000:3.0:1790736131.277270:0:7906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1790736131.278758:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1790736131.278794:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790736131.278809:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff941611930800/0x6aae200528fe615d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6164 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736131.278824:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff941611930800/0x6aae200528fe615d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6164 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790736131.278836:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790736131.278840:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff941604c0d800 from 5 10000000:01000000:0.0:1790736131.278843:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790736131.278898:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff941600031c00/0x6aae200528fe616b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736131.278921:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff941600031c00/0x6aae200528fe616b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736131.278934:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff941600031c00/0x6aae200528fe616b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736131.278964:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816074624:0@lo:101: 00000100:00100000:0.0:1790736131.279057:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736131.279140:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611973000 going to sleep for 11 seconds 00000100:00100000:0.0:1790736131.279166:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816074624 00000100:00100000:0.0:1790736131.279175:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816074624 00000100:00100000:0.0:1790736131.279224:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790736131.279235:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606655450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+16:5841:x1877722816074624:12345-0@lo:101: 00010000:00010000:0.0:1790736131.279253:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736131.279270:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941600030a00/0x6aae200528fe6172 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe616b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736131.279300:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941600030a00/0x6aae200528fe6172 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe616b expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736131.279313:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941600030a00/0x6aae200528fe6172 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe616b expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736131.279321:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941600030a00, rc 0) 00000100:00100000:0.0:1790736131.279366:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606655450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+17:5841:x1877722816074624:12345-0@lo:101: Request processed in 133us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736131.279372:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790736131.279599:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816074624:0@lo:101: 00010000:00010000:0.0:1790736131.279622:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff941600031c00/0x6aae200528fe616b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6172 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736131.279630:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff941600031c00/0x6aae200528fe616b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe6172 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736131.279678:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816074752:0@lo:256: 00000100:00100000:0.0:1790736131.279711:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736131.279724:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611973000 going to sleep for 11 seconds 00000100:00100000:0.0:1790736131.279735:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816074752 00000100:00100000:0.0:1790736131.279739:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816074752 00000100:00100000:0.0:1790736131.279755:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790736131.279760:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606656450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+17:5841:x1877722816074752:12345-0@lo:256: 20000000:01000000:0.0:1790736131.279775:0:5838:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790736131.279794:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790736131.279797:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1790736131.279865:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606656450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+17:5841:x1877722816074752:12345-0@lo:256: Request processed in 104us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736131.279872:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790736131.279895:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816074752:0@lo:256: 10000000:01000000:0.0:1790736131.279932:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790736131.279938:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff941600031c00/0x6aae200528fe616b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6172 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736131.279946:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff941600031c00/0x6aae200528fe616b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6172 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790736131.279953:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1790736131.279958:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1790736131.279961:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1790736131.279975:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff941600031800/0x6aae200528fe6179 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736131.279983:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff941600031800/0x6aae200528fe6179 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736131.279990:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff941600031800/0x6aae200528fe6179 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736131.280000:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816074880:0@lo:101: 00000100:00100000:0.0:1790736131.280021:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736131.280033:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611973000 going to sleep for 11 seconds 00000100:00100000:0.0:1790736131.280044:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816074880 00000100:00100000:0.0:1790736131.280047:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816074880 00000100:00100000:0.0:1790736131.280061:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1790736131.280067:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606657450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+17:5841:x1877722816074880:12345-0@lo:101: 00010000:00010000:0.0:1790736131.280073:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736131.280083:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941600030e00/0x6aae200528fe6180 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe6179 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736131.280126:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941600030e00/0x6aae200528fe6180 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe6179 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736131.280135:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941600030e00/0x6aae200528fe6180 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe6179 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736131.280141:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941600030e00, rc 0) 00000100:00100000:0.0:1790736131.280168:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606657450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+18:5841:x1877722816074880:12345-0@lo:101: Request processed in 101us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736131.280181:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1790736131.280211:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816074880:0@lo:101: 00010000:00010000:0.0:1790736131.280221:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff941600031800/0x6aae200528fe6179 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6180 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736131.280230:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff941600031800/0x6aae200528fe6179 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe6180 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736131.280278:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816075008:0@lo:501: 00000100:00100000:0.0:1790736131.280305:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736131.280317:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941637e58cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790736131.280329:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816075008 00000100:00100000:0.0:1790736131.280332:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816075008 00000100:00100000:0.0:1790736131.280349:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1790736131.280354:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606656c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+18:5841:x1877722816075008:12345-0@lo:501: 00000100:00100000:0.0:1790736131.282990:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606656c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+18:5841:x1877722816075008:12345-0@lo:501: Request processed in 2623us (2672us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736131.283005:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1790736131.283112:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816075008:0@lo:501: 00000100:00100000:0.0:1790736131.283174:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816075136:0@lo:503: 00000100:00100000:0.0:1790736131.283226:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736131.283265:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941637e58cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790736131.283281:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816075136 00000100:00100000:0.0:1790736131.283287:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816075136 00000100:00100000:0.0:1790736131.283323:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1790736131.283332:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94161094a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+18:5841:x1877722816075136:12345-0@lo:503: 00000100:00100000:0.0:1790736131.284999:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94161094a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+18:5841:x1877722816075136:12345-0@lo:503: Request processed in 1659us (1764us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736131.285012:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790736131.288215:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816075136:0@lo:503: 00000100:00100000:2.0:1790736131.291739:0:7907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063af800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:7907:1877722816075264:0@lo:502: 00000100:00100000:2.0:1790736131.291852:0:7907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736131.291905:0:7907:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162f7d79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790736131.292000:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816075264 00000100:00100000:3.0:1790736131.292010:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816075264 00000100:00100000:3.0:1790736131.295621:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1790736131.295654:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94161094bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+18:7907:x1877722816075264:12345-0@lo:502: 00000100:00100000:3.0:1790736131.296144:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94161094bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+18:7907:x1877722816075264:12345-0@lo:502: Request processed in 505us (4291us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736131.296154:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1790736131.296778:0:7907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063af800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:7907:1877722816075264:0@lo:502: 00000020:01000000:2.0:1790736131.296827:0:7907:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790736131.296837:0:7907:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1790736131.296848:0:7907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790736131.296850:0:7907:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1790736131.296855:0:7907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790736131.296859:0:7907:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.105@tcp to nid 0x20000c0a8cb69 (192.168.203.105@tcp) 00000020:01000000:2.0:1790736131.296887:0:7907:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1790736131.296890:0:7907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790736131.296910:0:7907:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff941637f699c0) 00000020:00000080:2.0:1790736131.296947:0:7907:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1790736131.296955:0:7907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790736131.297058:0:7907:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1790736131.297065:0:7907:0:(osd_handler.c:1577:osd_obd_connect()) connect #6 00000020:00000080:2.0:1790736131.297072:0:7907:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6aae200528fe618e 00010000:00080000:2.0:1790736131.297127:0:7907:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94162d355000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.105@tcp at head 00010000:00010000:2.0:1790736131.297734:0:7907:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1790736131.298208:0:7907:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1790736131.298225:0:7907:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1790736131.299225:0:7907:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790736131.299605:0:7907:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790736131.299654:0:7907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1790736131.299709:0:7907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1790736131.300325:0:7909:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790736131.300331:0:7909:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1790736131.301194:0:7907:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790736131.302610:0:7907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1790736131.302682:0:7907:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1790736131.302714:0:7907:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6aae200528fe6195 00000100:00080000:3.0:1790736131.302729:0:7907:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790736131.302744:0:7907:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff94162d355000 using connection 192.168.203.105@tcp/0@lo 00000100:00100000:3.0:1790736131.302796:0:7907:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94160838e680 x1877722816075392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790736131.302891:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1877722816075392:0@lo:8: 00000100:00100000:2.0:1790736131.302999:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790736131.309749:0:7907:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1790736131.309932:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877722816075520:0@lo:400: 00000100:00100000:3.0:1790736131.310044:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736131.310078:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790736131.310084:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1877722816075648:0@lo:400: 00000100:00100000:3.0:1790736131.310125:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736131.310154:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816075776:0@lo:400: 00000100:00100000:3.0:1790736131.310202:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736131.310312:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816075520 00000100:00100000:0.0:1790736131.310323:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816075520 00000100:00100000:0.0:1790736131.310377:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816075648 00000100:00100000:0.0:1790736131.310380:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816075648 00000100:00100000:0.0:1790736131.310399:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790736131.310426:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163381a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877722816075520:12345-0@lo:400: 00000100:00100000:0.0:1790736131.310499:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163381a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877722816075520:12345-0@lo:400: Request processed in 91us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736131.310506:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790736131.310535:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790736131.310542:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163381a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877722816075648:12345-0@lo:400: 00000100:00100000:0.0:1790736131.310572:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163381a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877722816075648:12345-0@lo:400: Request processed in 32us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736131.310578:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1790736131.310622:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94160838f480 x1877722816075648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790736147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790736131.310639:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1877722816075648:0@lo:400: 00010000:00080000:0.0:1790736131.310651:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94160838d880 x1877722816075520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790736147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790736131.310658:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877722816075520:0@lo:400: 00000100:00100000:3.0:1790736131.317749:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790736131.317776:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1877722816075904:0@lo:400: 00000100:00100000:3.0:1790736131.317858:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736131.318578:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816075904 00000100:00100000:3.0:1790736131.318592:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816075904 00000100:00100000:3.0:1790736131.318660:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790736131.318672:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633819f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877722816075904:12345-0@lo:400: 00000100:00100000:3.0:1790736131.318766:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633819f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877722816075904:12345-0@lo:400: Request processed in 96us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736131.318775:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1790736131.318840:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94160838ea00 x1877722816075904/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790736147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736131.318857:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1877722816075904:0@lo:400: 00000020:01000000:3.0:1790736131.318976:0:7907:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790736131.318984:0:7907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790736131.318987:0:7907:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1790736131.318990:0:7907:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790736131.319005:0:7907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790736131.319006:0:7907:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790736131.319011:0:7907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790736131.319012:0:7907:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1790736131.319055:0:7907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633819880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:7907:1877722816076032:0@lo:502: 00000100:00100000:3.0:1790736131.319131:0:7907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736131.319161:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816076032 00000100:00100000:3.0:1790736131.319166:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816076032 00000100:00100000:3.0:1790736131.319203:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1790736131.319210:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941610948c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+18:7907:x1877722816076032:12345-0@lo:502: 00000100:00100000:3.0:1790736131.320086:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941610948c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+18:7907:x1877722816076032:12345-0@lo:502: Request processed in 871us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736131.320115:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1790736131.320186:0:7907:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162a6b9900 going to sleep for 11 seconds 00000100:00100000:3.0:1790736131.320207:0:7907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633819880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:7907:1877722816076032:0@lo:502: 00000020:01000000:3.0:1790736131.320240:0:7907:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790736131.320246:0:7907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790736131.320249:0:7907:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:3.0:1790736131.320253:0:7907:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1790736131.320326:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1790736131.320348:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1790736131.320360:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff941600031800/0x6aae200528fe6179 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6180 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736131.320373:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff941600031800/0x6aae200528fe6179 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6180 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790736131.320861:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1790736131.320864:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff94160837b380 from 1 10000000:01000000:3.0:1790736131.320878:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790736131.320986:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c9800/0x6aae200528fe619c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736131.320997:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff94162f8c9800/0x6aae200528fe619c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736131.321009:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff94162f8c9800/0x6aae200528fe619c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736131.321032:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633819880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816076160:0@lo:101: 00000100:00100000:3.0:1790736131.321088:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736131.321145:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162a6b9900 going to sleep for 11 seconds 00000100:00100000:1.0:1790736131.323633:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816075392 00000100:00100000:1.0:1790736131.323663:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816075392 00000100:00100000:2.0:1790736131.324640:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816076160 00000100:00100000:2.0:1790736131.324650:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816076160 00000100:00100000:2.0:1790736131.324723:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1790736131.324734:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94161094b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+18:5841:x1877722816076160:12345-0@lo:101: 00010000:00010000:2.0:1790736131.324757:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736131.324781:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941611931200/0x6aae200528fe61a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe619c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736131.324822:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941611931200/0x6aae200528fe61a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe619c expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736131.324834:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941611931200/0x6aae200528fe61a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe619c expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736131.324868:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611931200, rc 0) 00000100:00100000:2.0:1790736131.324978:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94161094b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+19:5841:x1877722816076160:12345-0@lo:101: Request processed in 246us (3890us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736131.324985:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790736131.325625:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633819880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816076160:0@lo:101: 00010000:00010000:3.0:1790736131.325654:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff94162f8c9800/0x6aae200528fe619c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe61a3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736131.325664:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff94162f8c9800/0x6aae200528fe619c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe61a3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736131.325755:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633819880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816076288:0@lo:501: 00000100:00100000:3.0:1790736131.325800:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736131.325844:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162a6b9900 going to sleep for 11 seconds 00000100:00100000:0.0:1790736131.326594:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816075776 00000100:00100000:0.0:1790736131.326607:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816075776 00000100:00100000:0.0:1790736131.326669:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790736131.326695:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633818a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816075776:12345-0@lo:400: 00000100:00100000:0.0:1790736131.326771:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633818a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816075776:12345-0@lo:400: Request processed in 79us (16568us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736131.326779:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1790736131.326974:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94160838c380 x1877722816075776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736131.326990:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816075776:0@lo:400: 00000100:00100000:2.0:1790736131.327581:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816076288 00000100:00100000:2.0:1790736131.327590:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816076288 00000100:00100000:2.0:1790736131.327632:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1790736131.327640:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94161094b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+19:5841:x1877722816076288:12345-0@lo:501: 00000100:00100000:2.0:1790736131.328028:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94161094b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+19:5841:x1877722816076288:12345-0@lo:501: Request processed in 387us (2225us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790736131.328038:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1790736131.328437:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633819880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816076288:0@lo:501: 10000000:01000000:0.0:1790736131.328481:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1790736131.328494:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c9800/0x6aae200528fe619c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe61a3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736131.328507:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff94162f8c9800/0x6aae200528fe619c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe61a3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736131.328865:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790736131.328872:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3305:x1877722816075392:12345-0@lo:8: 00010000:00080000:2.0:1790736131.328970:0:6699:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:2.0:1790736131.329005:0:6699:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6aae200528fe61aa 00002000:00100000:2.0:1790736131.329023:0:6699:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff941603180000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1790736131.329029:0:6699:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1790736131.329034:0:6699:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1790736131.330158:0:6699:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790736131.331220:0:6699:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790736131.331270:0:6699:0:(import.c:65:import_set_state_nolock()) ffff941603185000 : changing import state from RECOVER to FULL 00010000:00080000:0.0:1790736131.331750:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94160838e680 x1877722816075392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790736141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790736131.331765:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790736131.331774:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1790736131.331784:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790736131.331791:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1790736131.331793:0:3305:0:(import.c:65:import_set_state_nolock()) ffff94162d355000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1790736131.331813:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790736131.331819:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1877722816075392:0@lo:8: 00000100:00100000:2.0:1790736131.332553:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1877722816075392:12345-0@lo:8: Request processed in 2535us (28410us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736131.332568:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:1.0:1790736131.335531:0:7909:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1790736131.335751:0:7909:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 203346656443ns, next at 0ns, rc = 0 00000004:00080000:1.0:1790736131.445399:0:7910:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1790736131.446011:0:7910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7910:1877722816076544:0@lo:7: 00000100:00100000:1.0:1790736131.446128:0:7910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736131.446194:0:7910:0:(client.c:2716:ptlrpc_set_wait()) set ffff94161ee64f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790736131.447707:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790736131.447740:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816076416:0@lo:13: 00000100:00100000:3.0:1790736131.447834:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736131.447897:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816076544 00000100:00100000:3.0:1790736131.447918:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816076544 00000100:00100000:3.0:1790736131.447999:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790736131.448010:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7910:x1877722816076544:12345-0@lo:7: 00000100:00080000:2.0:1790736131.459144:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790736131.459197:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816076416 00000100:00100000:2.0:1790736131.459211:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816076416 00000100:00100000:2.0:1790736131.459290:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790736131.459303:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633818000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1877722816076416:12345-0@lo:13: 00002000:00000024:0.0:1790736131.460552:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1790736131.460686:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633818000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1877722816076416:12345-0@lo:13: Request processed in 1382us (12849us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736131.460697:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1790736131.462723:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163fae1500 x1877722816076416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736147 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736131.462755:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816076416:0@lo:13: 00002000:00080000:3.0:1790736131.470265:0:6698:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1790736131.470633:0:6698:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1790736131.470773:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7910:x1877722816076544:12345-0@lo:7: Request processed in 22759us (24640us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736131.470786:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1790736131.470865:0:7910:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163fae2d80 x1877722816076544/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790736147 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736131.470883:0:7910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7910:1877722816076544:0@lo:7: 00000004:00080000:3.0:1790736131.470902:0:7910:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1790736131.470952:0:7910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163381b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7910:1877722816076672:0@lo:5: 00000100:00100000:3.0:1790736131.470991:0:7910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736131.471034:0:7910:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162f7d7780 going to sleep for 11 seconds 00000100:00100000:3.0:1790736131.471057:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816076672 00000100:00100000:3.0:1790736131.471065:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816076672 00000100:00100000:3.0:1790736131.471133:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790736131.471142:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163381bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7910:x1877722816076672:12345-0@lo:5: 00002000:00080000:3.0:1790736131.471174:0:6699:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1790736131.471179:0:6699:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1790736131.471616:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163381bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7910:x1877722816076672:12345-0@lo:5: Request processed in 474us (624us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1790736131.471623:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1790736131.471660:0:7910:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163381b480 x1877722816076672/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790736147 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736131.471689:0:7910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163381b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7910:1877722816076672:0@lo:5: 00000004:00080000:3.0:1790736131.471700:0:7910:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1790736131.471730:0:7910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633818700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7910:1877722816076800:0@lo:700: 00000100:00100000:3.0:1790736131.471757:0:7910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736131.471776:0:7910:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162f7d7780 going to sleep for 11 seconds 00000100:00100000:3.0:1790736131.471794:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816076800 00000100:00100000:3.0:1790736131.471799:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816076800 00000100:00100000:3.0:1790736131.471828:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790736131.471834:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633819180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7910:x1877722816076800:12345-0@lo:700: 00000100:00100000:3.0:1790736131.471863:0:6706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633819500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6706:1877722816076928:0@lo:700: 00000100:00100000:3.0:1790736131.471891:0:6706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736131.471908:0:6706:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162f7d7240 going to sleep for 11 seconds 00000100:00100000:3.0:1790736131.471935:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816076928 00000100:00100000:3.0:1790736131.471939:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816076928 00000100:00100000:3.0:1790736131.471967:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790736131.471974:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633818380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6706:x1877722816076928:12345-0@lo:700: 00000004:00080000:2.0:1790736131.529797:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:2.0:1790736131.623699:0:5850:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1790736131.630880:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633818380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6706:x1877722816076928:12345-0@lo:700: Request processed in 158892us (158973us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736131.630899:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790736131.631516:0:6706:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff941633819500 x1877722816076928/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790736147 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736131.631546:0:6706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633819500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6706:1877722816076928:0@lo:700: 40000000:02000000:3.0:1790736131.631566:0:6706:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:1.0:1790736131.773927:0:7658:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1790736131.773961:0:7658:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:2.0:1790736131.774219:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633819180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7910:x1877722816076800:12345-0@lo:700: Request processed in 302377us (302454us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736131.774235:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790736131.774301:0:7910:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff941633818700 x1877722816076800/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790736147 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736131.774315:0:7910:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1790736131.774341:0:7910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633818700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7910:1877722816076800:0@lo:700: 00010000:00010000:3.0:1790736131.864329:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:02000040:1.0:1790736131.882185:0:7910:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1790736131.890902:0:7910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7910:1877722816077056:0@lo:5: 00000100:00100000:1.0:1790736131.891121:0:7910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736131.891175:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816077056 00000100:00100000:3.0:1790736131.891185:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816077056 00000100:00100000:1.0:1790736131.891207:0:7910:0:(client.c:2716:ptlrpc_set_wait()) set ffff94163f9ce900 going to sleep for 11 seconds 00000100:00100000:3.0:1790736131.891245:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790736131.891261:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7910:x1877722816077056:12345-0@lo:5: 00002000:00080000:2.0:1790736131.912962:0:6699:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1790736131.913146:0:6699:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1790736131.924559:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7910:x1877722816077056:12345-0@lo:5: Request processed in 33287us (33425us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1790736131.924575:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1790736131.926307:0:7910:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163fae1500 x1877722816077056/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790736147 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790736131.926335:0:7910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7910:1877722816077056:0@lo:5: 00000004:00080000:2.0:1790736131.926357:0:7910:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1790736132.891946:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790736133.269706:0:8007:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg305-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790736133.913789:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736134.933836:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790736135.317513:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790736135.317551:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816077184:0@lo:13: 00000100:00100000:2.0:1790736135.317649:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736135.317895:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816077184 00000100:00100000:0.0:1790736135.317906:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816077184 00000100:00100000:0.0:1790736135.317985:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790736135.317997:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816077184:12345-0@lo:13: 00002000:00000024:0.0:1790736135.318043:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790736135.318127:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816077184:12345-0@lo:13: Request processed in 133us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736135.318135:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1790736135.318234:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790736135.318273:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94162ed91500 x1877722816077184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736151 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790736135.318295:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816077184:0@lo:13: 00010000:00010000:1.0:1790736135.957379:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736136.341700:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163381ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816077696:0@lo:400: 00000100:00100000:3.0:1790736136.341805:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736136.341858:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633819500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816077312:0@lo:400: 00000100:00100000:3.0:1790736136.341894:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790736136.341900:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163381b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1877722816077568:0@lo:400: 00000100:00100000:1.0:1790736136.342071:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163381aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877722816077440:0@lo:400: 00000100:00100000:0.0:1790736136.344333:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736136.345259:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633819c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1877722816077824:0@lo:400: 00000100:00100000:3.0:1790736136.345279:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736136.345311:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736136.345660:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816077696 00000100:00100000:3.0:1790736136.345672:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816077696 00000100:00100000:3.0:1790736136.345741:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790736136.345752:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633818e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816077696:12345-0@lo:400: 00000100:00100000:3.0:1790736136.345824:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633818e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816077696:12345-0@lo:400: Request processed in 74us (4020us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736136.345832:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790736136.345860:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816077312 00000100:00100000:3.0:1790736136.345864:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816077312 00000100:00100000:3.0:1790736136.345893:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790736136.345900:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94161094a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+19:3308:x1877722816077312:12345-0@lo:400: 00000100:00100000:3.0:1790736136.345941:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94161094a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+19:3308:x1877722816077312:12345-0@lo:400: Request processed in 42us (1621us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736136.345948:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790736136.345979:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816077568 00000100:00100000:3.0:1790736136.345982:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816077568 00000100:00100000:3.0:1790736136.346020:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816077824 00000100:00100000:3.0:1790736136.346023:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816077824 00000100:00100000:3.0:1790736136.346055:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790736136.346061:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633818700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877722816077568:12345-0@lo:400: 00000100:00100000:3.0:1790736136.346136:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633818700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877722816077568:12345-0@lo:400: Request processed in 75us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736136.346143:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790736136.346156:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790736136.346162:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162ed91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877722816077824:12345-0@lo:400: 00010000:00080000:0.0:1790736136.347161:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163381b800 x1877722816077568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790736152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790736136.347186:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163381b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1877722816077568:0@lo:400: 00010000:00080000:0.0:1790736136.347207:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163381ad80 x1877722816077696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790736136.347216:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163381ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816077696:0@lo:400: 00000100:00100000:0.0:1790736136.347264:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633819500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816077312:0@lo:400: 00000100:00080000:0.0:1790736136.347307:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790736136.348321:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736136.348739:0:5844:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1790736136.348752:0:5844:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1790736136.350024:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162ed91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877722816077824:12345-0@lo:400: Request processed in 3850us (4700us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736136.350041:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790736136.350085:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816077440 00000100:00100000:3.0:1790736136.350111:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816077440 00000100:00100000:3.0:1790736136.350170:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790736136.350180:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877722816077440:12345-0@lo:400: 00000100:00100000:3.0:1790736136.350236:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877722816077440:12345-0@lo:400: Request processed in 57us (1922us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736136.350261:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1790736136.350314:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff941633819c00 x1877722816077824/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790736152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736136.350331:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633819c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1877722816077824:0@lo:400: 00010000:00080000:1.0:1790736136.350809:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163381aa00 x1877722816077440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790736152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736136.350820:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163381aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877722816077440:0@lo:400: 00000100:00100000:1.0:1790736136.350833:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163381b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816077952:0@lo:400: 00000100:00100000:1.0:1790736136.350881:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736136.350987:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816077952 00000100:00100000:3.0:1790736136.350993:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816077952 00000100:00100000:3.0:1790736136.351046:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790736136.351056:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1877722816077952:12345-0@lo:400: 00000100:00100000:3.0:1790736136.351131:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1877722816077952:12345-0@lo:400: Request processed in 76us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736136.351149:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1790736136.351200:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163381b100 x1877722816077952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736136.351210:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163381b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816077952:0@lo:400: 00000100:00080000:1.0:1790736136.351895:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790736136.855164:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790736136.855212:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816078080:0@lo:13: 00000100:00100000:2.0:1790736136.855318:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736136.855414:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816078080 00000100:00100000:2.0:1790736136.855424:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816078080 00000100:00100000:2.0:1790736136.855480:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790736136.855499:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1877722816078080:12345-0@lo:13: 00002000:00000024:2.0:1790736136.855542:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790736136.855593:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1877722816078080:12345-0@lo:13: Request processed in 95us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736136.855601:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1790736136.855650:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9416063ad500 x1877722816078080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736152 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790736136.855670:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816078080:0@lo:13: 00000001:00080000:0.0:1790736136.952070:0:7658:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1790736136.981552:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736138.005810:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736139.012444:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736139.012609:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797179008 00000100:00100000:2.0:1790736139.012622:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797179008 00000100:00100000:2.0:1790736139.012680:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 113 00000100:00100000:2.0:1790736139.012691:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941610948050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2352:x1877722797179008:12345-192.168.203.5@tcp:250: 00010000:00080000:2.0:1790736139.012725:0:5836:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 637df299-95a2-42b2-90c0-64260eee1701@192.168.203.5@tcp t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:2.0:1790736139.012762:0:5836:0:(genops.c:1384:class_connect()) connect: client 637df299-95a2-42b2-90c0-64260eee1701, cookie 0x6aae200528fe61b1 00000100:00080000:2.0:1790736139.012934:0:5836:0:(import.c:65:import_set_state_nolock()) ffff941603184000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790736139.013024:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941610948050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+5:2352:x1877722797179008:12345-192.168.203.5@tcp:250: Request processed in 332us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736139.013032:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 113 00000100:00100000:2.0:1790736139.016156:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736139.016200:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797179136 00000100:00100000:2.0:1790736139.016214:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797179136 00000100:00100000:2.0:1790736139.016275:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 114 00000100:00100000:2.0:1790736139.016287:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941610948450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+5:5581:x1877722797179136:12345-192.168.203.5@tcp:101: 00010000:00010000:2.0:1790736139.016320:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736139.016520:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941611930200/0x6aae200528fe61b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x92962417a526c67 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736139.016563:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941611930200/0x6aae200528fe61b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526c67 expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736139.016577:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941611930200/0x6aae200528fe61b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526c67 expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736139.016589:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611930200, rc 0) 00000100:00100000:2.0:1790736139.016853:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941610948450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+6:5581:x1877722797179136:12345-192.168.203.5@tcp:101: Request processed in 566us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736139.017075:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 114 00000100:00100000:2.0:1790736139.019481:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736139.019997:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797179264 00000100:00100000:2.0:1790736139.020012:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797179264 00000100:00100000:2.0:1790736139.020271:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 115 00000100:00100000:2.0:1790736139.020285:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941610949050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+6:5581:x1877722797179264:12345-192.168.203.5@tcp:501: 00000100:00100000:2.0:1790736139.020674:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941610949050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+6:5581:x1877722797179264:12345-192.168.203.5@tcp:501: Request processed in 390us (1211us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790736139.020686:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 115 00000100:00100000:2.0:1790736139.025801:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736139.026009:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797179392 00000100:00100000:3.0:1790736139.026024:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797179392 00000100:00100000:3.0:1790736139.026110:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 116 00000100:00100000:3.0:1790736139.026123:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941610949c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+6:5581:x1877722797179392:12345-192.168.203.5@tcp:101: 00010000:00010000:3.0:1790736139.026146:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736139.026168:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94162f8c8400/0x6aae200528fe61bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x92962417a526c6e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736139.026203:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94162f8c8400/0x6aae200528fe61bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526c6e expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736139.026215:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94162f8c8400/0x6aae200528fe61bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526c6e expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736139.026226:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c8400, rc 0) 00000100:00100000:3.0:1790736139.026298:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941610949c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+7:5581:x1877722797179392:12345-192.168.203.5@tcp:101: Request processed in 179us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736139.026305:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 116 00000100:00100000:2.0:1790736139.028565:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736139.028726:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797179520 00000100:00100000:3.0:1790736139.028739:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797179520 00000100:00100000:3.0:1790736139.028799:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 117 00000100:00100000:3.0:1790736139.028810:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941610949850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+7:5581:x1877722797179520:12345-192.168.203.5@tcp:501: 00000100:00100000:3.0:1790736139.029217:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941610949850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+8:5581:x1877722797179520:12345-192.168.203.5@tcp:501: Request processed in 407us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736139.029226:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 117 00010000:00010000:2.0:1790736139.030812:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736139.032062:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736139.032875:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797179648 00000100:00100000:2.0:1790736139.032890:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797179648 00000100:00100000:2.0:1790736139.033353:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 118 00000100:00100000:2.0:1790736139.033387:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941610948850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+8:5581:x1877722797179648:12345-192.168.203.5@tcp:503: 00000100:00100000:2.0:1790736139.033807:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941610948850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+8:5581:x1877722797179648:12345-192.168.203.5@tcp:503: Request processed in 422us (1755us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736139.033816:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 118 00000100:00100000:3.0:1790736139.043148:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736139.043255:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797179776 00000100:00100000:1.0:1790736139.043271:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797179776 00000100:00100000:1.0:1790736139.043447:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 119 00000100:00100000:1.0:1790736139.043460:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941610949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+8:5599:x1877722797179776:12345-192.168.203.5@tcp:502: 00000100:00100000:1.0:1790736139.045208:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941610949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+8:5599:x1877722797179776:12345-192.168.203.5@tcp:502: Request processed in 1737us (2108us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736139.045224:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 119 00000100:00100000:2.0:1790736139.065334:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736139.065494:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797179904 00000100:00100000:3.0:1790736139.065508:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797179904 00000100:00100000:3.0:1790736139.065580:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 120 00000100:00100000:3.0:1790736139.065591:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94161094a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+8:5599:x1877722797179904:12345-192.168.203.5@tcp:502: 00000100:00100000:0.0:1790736139.066409:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94161094a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+8:5599:x1877722797179904:12345-192.168.203.5@tcp:502: Request processed in 814us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736139.066421:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 120 00000100:00100000:3.0:1790736139.071143:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736139.071312:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797180032 00000100:00100000:1.0:1790736139.071326:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797180032 00000100:00100000:1.0:1790736139.071398:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 121 00000100:00100000:1.0:1790736139.071411:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94161094b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+8:5581:x1877722797180032:12345-192.168.203.5@tcp:101: 00010000:00010000:1.0:1790736139.071434:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736139.071459:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94162156e800/0x6aae200528fe61c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x92962417a526c98 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736139.071539:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94162156e800/0x6aae200528fe61c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526c98 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736139.071553:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94162156e800/0x6aae200528fe61c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526c98 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736139.071564:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162156e800, rc 0) 00000100:00100000:1.0:1790736139.071827:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94161094b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+9:5581:x1877722797180032:12345-192.168.203.5@tcp:101: Request processed in 417us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736139.071835:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 121 00000100:00100000:2.0:1790736139.079087:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736139.079285:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797180160 00000100:00100000:0.0:1790736139.079300:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797180160 00000100:00100000:0.0:1790736139.079378:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 122 00000100:00100000:0.0:1790736139.079391:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94161094ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+9:5581:x1877722797180160:12345-192.168.203.5@tcp:256: 20000000:01000000:0.0:1790736139.079426:0:5836:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1790736139.079456:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1790736139.079460:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1790736139.079464:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1790736139.079479:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1790736139.084202:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94161094ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+9:5581:x1877722797180160:12345-192.168.203.5@tcp:256: Request processed in 4797us (5113us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736139.084221:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 122 00000100:00100000:3.0:1790736139.093074:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736139.093779:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797180288 00000100:00100000:2.0:1790736139.093793:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797180288 00000100:00100000:2.0:1790736139.093914:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 123 00000100:00100000:2.0:1790736139.093927:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416055c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+9:5581:x1877722797180288:12345-192.168.203.5@tcp:101: 00010000:00010000:2.0:1790736139.096570:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736139.096686:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941611931800/0x6aae200528fe61cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x92962417a526c9f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736139.096736:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941611931800/0x6aae200528fe61cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526c9f expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736139.096749:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941611931800/0x6aae200528fe61cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526c9f expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736139.096760:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611931800, rc 0) 00000100:00100000:2.0:1790736139.096854:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416055c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+10:5581:x1877722797180288:12345-192.168.203.5@tcp:101: Request processed in 2927us (4264us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736139.096865:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 123 00000100:00100000:3.0:1790736139.100395:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736139.100775:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797180416 00000100:00100000:2.0:1790736139.100792:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797180416 00000100:00100000:2.0:1790736139.100862:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 124 00000100:00100000:2.0:1790736139.100873:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416055c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+10:5581:x1877722797180416:12345-192.168.203.5@tcp:501: 00000100:00100000:2.0:1790736139.101281:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416055c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+10:5581:x1877722797180416:12345-192.168.203.5@tcp:501: Request processed in 407us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736139.101291:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 124 00000100:00100000:2.0:1790736139.115032:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736139.115546:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797180544 00000100:00100000:1.0:1790736139.115562:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797180544 00000100:00100000:1.0:1790736139.115642:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 125 00000100:00100000:1.0:1790736139.115654:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416055c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+10:5581:x1877722797180544:12345-192.168.203.5@tcp:503: 00000100:00100000:1.0:1790736139.116497:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416055c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+10:5581:x1877722797180544:12345-192.168.203.5@tcp:503: Request processed in 837us (1473us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736139.116509:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 125 00000100:00100000:1.0:1790736139.122727:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736139.122928:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797180672 00000100:00100000:0.0:1790736139.122942:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797180672 00000100:00100000:0.0:1790736139.123060:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 126 00000100:00100000:0.0:1790736139.123072:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416055c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+10:5603:x1877722797180672:12345-192.168.203.5@tcp:502: 00000100:00100000:0.0:1790736139.123505:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416055c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+10:5603:x1877722797180672:12345-192.168.203.5@tcp:502: Request processed in 433us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736139.123514:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 126 00000100:00100000:1.0:1790736139.130134:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736139.130356:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797180800 00000100:00100000:2.0:1790736139.130370:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797180800 00000100:00100000:2.0:1790736139.130440:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 127 00000100:00100000:2.0:1790736139.130452:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416055ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+10:5603:x1877722797180800:12345-192.168.203.5@tcp:502: 00000100:00100000:2.0:1790736139.130746:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416055ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+10:5603:x1877722797180800:12345-192.168.203.5@tcp:502: Request processed in 295us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736139.130755:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 127 00000100:00100000:2.0:1790736139.139184:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736139.139270:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797180928 00000100:00100000:0.0:1790736139.139283:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797180928 00000100:00100000:0.0:1790736139.139415:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 4 00000100:00100000:0.0:1790736139.139427:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2352:x1877722797180928:12345-192.168.203.5@tcp:38: 00010000:00080000:0.0:1790736139.139477:0:5844:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from f945944d-9086-46a2-a91c-8bc7b88e8918@192.168.203.5@tcp t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:0.0:1790736139.139543:0:5844:0:(genops.c:1384:class_connect()) connect: client f945944d-9086-46a2-a91c-8bc7b88e8918, cookie 0x6aae200528fe61d4 00000004:00100000:0.0:1790736139.139584:0:5844:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1790736139.139592:0:5844:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1790736139.206907:0:5844:0:(import.c:65:import_set_state_nolock()) ffff9416181ac000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790736139.207263:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2352:x1877722797180928:12345-192.168.203.5@tcp:38: Request processed in 67833us (68101us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736139.207278:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 4 00010000:00010000:0.0:1790736140.053390:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790736140.212295:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736140.212615:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797181184 00000100:00100000:0.0:1790736140.212628:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797181184 00000100:00100000:2.0:1790736140.213814:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736140.214006:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797181056 00000100:00100000:3.0:1790736140.214023:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797181056 00000100:00100000:3.0:1790736140.214128:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 5 00000100:00100000:3.0:1790736140.214140:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+7:0:x1877722797181056:12345-192.168.203.5@tcp:41: 00000004:00000024:3.0:1790736140.214196:0:5845:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1790736140.214280:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+7:0:x1877722797181056:12345-192.168.203.5@tcp:41: Request processed in 143us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736140.214289:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 5 00000100:00100000:0.0:1790736140.215705:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6 00000100:00100000:0.0:1790736140.215721:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+6:5581:x1877722797181184:12345-192.168.203.5@tcp:41: 00000004:00000024:0.0:1790736140.215755:0:8114:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790736140.215822:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+6:5581:x1877722797181184:12345-192.168.203.5@tcp:41: Request processed in 106us (3541us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736140.215830:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6 00000100:00080000:1.0:1790736140.221592:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790736140.224153:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736140.224800:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797181312 00000100:00100000:3.0:1790736140.224814:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797181312 00000100:00100000:3.0:1790736140.224901:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 7 00000100:00100000:3.0:1790736140.224914:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+6:5581:x1877722797181312:12345-192.168.203.5@tcp:40: 00000100:00100000:3.0:1790736140.225262:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+6:5581:x1877722797181312:12345-192.168.203.5@tcp:40: Request processed in 350us (1123us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736140.225291:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 7 00000100:00100000:3.0:1790736140.232562:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736140.232612:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736140.232870:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797181824 00000100:00100000:2.0:1790736140.232883:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797181824 00000100:00100000:2.0:1790736140.232951:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 128 00000100:00100000:2.0:1790736140.232963:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+10:2356:x1877722797181824:12345-192.168.203.5@tcp:400: 00000100:00100000:2.0:1790736140.233069:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+10:2356:x1877722797181824:12345-192.168.203.5@tcp:400: Request processed in 107us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736140.233079:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 128 00000100:00100000:0.0:1790736140.234279:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797181696 00000100:00100000:0.0:1790736140.234291:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797181696 00000100:00100000:0.0:1790736140.234362:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 0 00000100:00100000:0.0:1790736140.234373:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163381b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+6:5581:x1877722797181696:12345-192.168.203.5@tcp:33: 00000100:00100000:0.0:1790736140.240694:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736140.240806:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736140.248044:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797181440 00000100:00100000:2.0:1790736140.248067:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797181440 00000100:00100000:2.0:1790736140.248152:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797181568 00000100:00100000:2.0:1790736140.248156:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797181568 00000100:00100000:2.0:1790736140.248180:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 8 00000100:00100000:2.0:1790736140.248191:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162ed90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1877722797181440:12345-192.168.203.5@tcp:8: 00010000:00080000:2.0:1790736140.248234:0:6699:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from f945944d-9086-46a2-a91c-8bc7b88e8918@192.168.203.5@tcp t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:2.0:1790736140.248273:0:6699:0:(genops.c:1384:class_connect()) connect: client f945944d-9086-46a2-a91c-8bc7b88e8918, cookie 0x6aae200528fe61db 00002000:00100000:2.0:1790736140.248289:0:6699:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f945944d-9086-46a2-a91c-8bc7b88e8918/ffff941603183800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790736140.248319:0:6699:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790736140.249244:0:6699:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790736140.249297:0:6699:0:(import.c:65:import_set_state_nolock()) ffff941603186800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790736140.249519:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162ed90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2352:x1877722797181440:12345-192.168.203.5@tcp:8: Request processed in 1327us (8837us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736140.249530:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 8 00000100:00100000:2.0:1790736140.249561:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 9 00000100:00100000:2.0:1790736140.249568:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162ed91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1877722797181568:12345-192.168.203.5@tcp:8: 00010000:00080000:2.0:1790736140.249593:0:6699:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from f945944d-9086-46a2-a91c-8bc7b88e8918@192.168.203.5@tcp t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:2.0:1790736140.249616:0:6699:0:(genops.c:1384:class_connect()) connect: client f945944d-9086-46a2-a91c-8bc7b88e8918, cookie 0x6aae200528fe61e2 00002000:00100000:2.0:1790736140.249631:0:6699:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f945944d-9086-46a2-a91c-8bc7b88e8918/ffff941603181800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790736140.249652:0:6699:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790736140.249982:0:6699:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790736140.250002:0:6699:0:(import.c:65:import_set_state_nolock()) ffff941603185800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790736140.250035:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162ed91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2352:x1877722797181568:12345-192.168.203.5@tcp:8: Request processed in 466us (9229us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736140.250062:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 9 00000004:00080000:2.0:1790736140.262507:0:5846:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 28020us 00000004:00200000:2.0:1790736140.281431:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1790736140.281987:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163381b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+6:5581:x1877722797181696:12345-192.168.203.5@tcp:33: Request processed in 47607us (49431us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736140.282006:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 0 00000100:00100000:1.0:1790736140.440002:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790736140.440038:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816078208:0@lo:13: 00000100:00100000:1.0:1790736140.440181:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736140.440797:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816078208 00000100:00100000:0.0:1790736140.440808:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816078208 00000100:00100000:0.0:1790736140.440898:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790736140.440910:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816078208:12345-0@lo:13: 00002000:00000024:0.0:1790736140.440939:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1790736140.441152:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790736140.441221:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816078208:12345-0@lo:13: Request processed in 313us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736140.441229:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1790736140.441347:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94162ed93800 x1877722816078208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736156 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736140.441375:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816078208:0@lo:13: 00000100:00100000:0.0:1790736140.548935:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736140.554556:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797181952 00000100:00100000:2.0:1790736140.554582:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797181952 00000100:00100000:2.0:1790736140.554767:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 8 00000100:00100000:2.0:1790736140.554781:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162ed93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+6:5620:x1877722797181952:12345-192.168.203.5@tcp:101: 00010000:00010000:2.0:1790736140.554810:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736140.554845:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe61e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526cc9 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736140.554937:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe61f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736140.554955:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe61f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736140.554974:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe61f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790736140.555046:0:8114:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790736140.555051:0:8114:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790736140.555071:0:8114:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe61f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736140.555138:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe61e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526cc9 expref: 8 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736140.555182:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe61f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526cc9 expref: 7 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736140.555192:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94160678a200) 00010000:00010000:2.0:1790736140.555196:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790736140.555200:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611931c00, rc 0) 00000100:00100000:2.0:1790736140.555302:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162ed93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+7:5620:x1877722797181952:12345-192.168.203.5@tcp:101: Request processed in 524us (6382us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736140.555309:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 8 00010000:00010000:2.0:1790736141.077355:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736141.462201:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163381aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816078720:0@lo:400: 00000100:00100000:3.0:1790736141.462303:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736141.462520:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790736141.462527:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633819880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1877722816078592:0@lo:400: 00000100:00100000:3.0:1790736141.462592:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736141.462634:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816078592 00000100:00100000:3.0:1790736141.462645:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816078592 00000100:00100000:3.0:1790736141.463246:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790736141.463262:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877722816078592:12345-0@lo:400: 00000100:00100000:0.0:1790736141.463416:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633819c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816078336:0@lo:400: 00000100:00100000:2.0:1790736141.463554:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816078720 00000100:00100000:2.0:1790736141.463561:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816078720 00000100:00100000:2.0:1790736141.463598:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790736141.463606:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163381b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816078720:12345-0@lo:400: 00000100:00100000:1.0:1790736141.463671:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163381b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877722816078464:0@lo:400: 00000100:00100000:3.0:1790736141.463732:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877722816078592:12345-0@lo:400: Request processed in 475us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736141.463739:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790736141.463791:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633819880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1877722816078592:0@lo:400: 00000100:00100000:0.0:1790736141.465043:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736141.465148:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163381b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816078720:12345-0@lo:400: Request processed in 1540us (2843us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736141.465160:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1790736141.465225:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163381aa00 x1877722816078720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790736141.465242:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163381aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816078720:0@lo:400: 00000100:00100000:0.0:1790736141.465274:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633819500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1877722816078848:0@lo:400: 00000100:00080000:2.0:1790736141.465288:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790736141.465320:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736141.465359:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816078848 00000100:00100000:2.0:1790736141.465367:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816078848 00000100:00100000:2.0:1790736141.465411:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790736141.465417:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162ed91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877722816078848:12345-0@lo:400: 00000100:00100000:2.0:1790736141.465514:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162ed91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877722816078848:12345-0@lo:400: Request processed in 97us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736141.465521:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1790736141.465536:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790736141.466196:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816078336 00000100:00100000:3.0:1790736141.466204:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816078336 00000100:00100000:1.0:1790736141.466210:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736141.466249:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163381ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816078976:0@lo:400: 00000100:00100000:3.0:1790736141.466265:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1790736141.466276:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+19:3308:x1877722816078336:12345-0@lo:400: 00000100:00100000:1.0:1790736141.466284:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736141.466395:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+19:3308:x1877722816078336:12345-0@lo:400: Request processed in 122us (1359us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736141.466412:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1790736141.466488:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816078976 00000100:00100000:3.0:1790736141.466492:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816078976 00000100:00100000:3.0:1790736141.466526:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790736141.466533:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816078976:12345-0@lo:400: 00000100:00100000:1.0:1790736141.466570:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633819c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816078336:0@lo:400: 00000100:00100000:3.0:1790736141.466580:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816078976:12345-0@lo:400: Request processed in 46us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736141.466590:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790736141.466592:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633819500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1877722816078848:0@lo:400: 00010000:00080000:1.0:1790736141.466629:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163381ad80 x1877722816078976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736141.466640:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1790736141.466650:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163381ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816078976:0@lo:400: 00000100:00100000:2.0:1790736141.466789:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816078464 00000100:00100000:2.0:1790736141.466794:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816078464 00000100:00100000:2.0:1790736141.466830:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790736141.466837:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877722816078464:12345-0@lo:400: 00000100:00100000:2.0:1790736141.466887:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877722816078464:12345-0@lo:400: Request processed in 51us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736141.466895:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1790736141.466986:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790736141.467182:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163381b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877722816078464:0@lo:400: 00000100:00100000:0.0:1790736141.973458:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790736141.973496:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816079104:0@lo:13: 00000100:00100000:0.0:1790736141.973603:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736141.974032:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816079104 00000100:00100000:2.0:1790736141.974045:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816079104 00000100:00100000:2.0:1790736141.974138:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790736141.974150:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162ed93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816079104:12345-0@lo:13: 00002000:00000024:2.0:1790736141.974183:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790736141.974259:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162ed93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816079104:12345-0@lo:13: Request processed in 110us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736141.974267:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1790736141.974367:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9416063ace00 x1877722816079104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736157 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736141.974393:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816079104:0@lo:13: 00010000:00010000:0.0:1790736142.101681:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736142.772403:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736142.772595:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797182080 00000100:00100000:2.0:1790736142.772608:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797182080 00000100:00100000:2.0:1790736142.772719:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 9 00000100:00100000:2.0:1790736142.772733:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+7:5672:x1877722797182080:12345-192.168.203.5@tcp:41: 00000004:00000024:2.0:1790736142.772801:0:5844:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790736142.772900:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+7:5672:x1877722797182080:12345-192.168.203.5@tcp:41: Request processed in 171us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736142.772925:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 9 00000100:00080000:0.0:1790736142.774896:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790736142.792768:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736142.792991:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797182208 00000100:00100000:2.0:1790736142.793006:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797182208 00000100:00100000:2.0:1790736142.793135:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 11 00000100:00100000:2.0:1790736142.793147:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f945944d-9086-46a2-a91c-8bc7b88e8918+6:5672:x1877722797182208:12345-192.168.203.5@tcp:13: 00002000:00000024:2.0:1790736142.793200:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790736142.793292:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f945944d-9086-46a2-a91c-8bc7b88e8918+6:5672:x1877722797182208:12345-192.168.203.5@tcp:13: Request processed in 147us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736142.793307:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 11 00000100:00080000:0.0:1790736142.793500:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790736142.798682:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736142.799215:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797182336 00000100:00100000:2.0:1790736142.799230:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797182336 00000100:00100000:2.0:1790736142.799410:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 12 00000100:00100000:2.0:1790736142.799424:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f945944d-9086-46a2-a91c-8bc7b88e8918+6:5672:x1877722797182336:12345-192.168.203.5@tcp:13: 00002000:00000024:2.0:1790736142.799576:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790736142.799663:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f945944d-9086-46a2-a91c-8bc7b88e8918+6:5672:x1877722797182336:12345-192.168.203.5@tcp:13: Request processed in 242us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736142.799672:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 12 00000100:00080000:0.0:1790736142.811904:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1790736143.125761:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736144.153580:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790736144.153597:0:6725:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f945944d-9086-46a2-a91c-8bc7b88e8918 00000001:00100000:2.0:1790736144.609533:0:5867:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f945944d-9086-46a2-a91c-8bc7b88e8918 00000001:00100000:0.0:1790736145.124804:0:7658:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f945944d-9086-46a2-a91c-8bc7b88e8918 00010000:00010000:0.0:1790736145.173402:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736145.420268:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736145.420309:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736145.420342:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736145.420369:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736145.420410:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797182720 00000100:00100000:1.0:1790736145.420434:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797182720 00000100:00100000:1.0:1790736145.420512:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797182848 00000100:00100000:1.0:1790736145.420515:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797182848 00000100:00100000:1.0:1790736145.420535:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 9 00000100:00100000:1.0:1790736145.420547:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2354:x1877722797182720:12345-192.168.203.5@tcp:400: 00000100:00100000:1.0:1790736145.420637:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2354:x1877722797182720:12345-192.168.203.5@tcp:400: Request processed in 93us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736145.420645:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 9 00000100:00100000:1.0:1790736145.420663:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 10 00000100:00100000:1.0:1790736145.420687:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2354:x1877722797182848:12345-192.168.203.5@tcp:400: 00000100:00100000:1.0:1790736145.420712:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2354:x1877722797182848:12345-192.168.203.5@tcp:400: Request processed in 26us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736145.420717:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 10 00000100:00100000:1.0:1790736145.420736:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797182592 00000100:00100000:1.0:1790736145.420739:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797182592 00000100:00100000:1.0:1790736145.420769:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 25 00000100:00100000:1.0:1790736145.420774:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2354:x1877722797182592:12345-192.168.203.5@tcp:400: 00000100:00100000:1.0:1790736145.420801:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2354:x1877722797182592:12345-192.168.203.5@tcp:400: Request processed in 27us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736145.420807:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 25 00000100:00080000:1.0:1790736145.420827:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790736145.420834:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790736145.420837:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790736145.421235:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797182464 00000100:00100000:3.0:1790736145.421241:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797182464 00000100:00100000:3.0:1790736145.421279:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 130 00000100:00100000:3.0:1790736145.421288:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+10:2354:x1877722797182464:12345-192.168.203.5@tcp:400: 00000100:00100000:3.0:1790736145.421327:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+10:2354:x1877722797182464:12345-192.168.203.5@tcp:400: Request processed in 41us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736145.421335:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 130 00000100:00100000:2.0:1790736145.557807:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790736145.557841:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816079232:0@lo:13: 00000100:00100000:2.0:1790736145.557937:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736145.558383:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816079232 00000100:00100000:3.0:1790736145.558395:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816079232 00000100:00100000:3.0:1790736145.558487:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790736145.558498:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816079232:12345-0@lo:13: 00002000:00000024:3.0:1790736145.558547:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790736145.558603:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816079232:12345-0@lo:13: Request processed in 107us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736145.558623:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1790736145.558748:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94162ed92300 x1877722816079232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736161 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790736145.558771:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816079232:0@lo:13: 00000100:00080000:0.0:1790736145.558897:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1790736145.948871:0:8318:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1790736146.206413:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790736146.582481:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1877722816079616:0@lo:400: 00000100:00100000:0.0:1790736146.582583:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736146.582794:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790736146.582802:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816079744:0@lo:400: 00000100:00100000:0.0:1790736146.582834:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736146.582882:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816079616 00000100:00100000:0.0:1790736146.582893:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816079616 00000100:00100000:0.0:1790736146.582961:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790736146.582973:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160838c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877722816079616:12345-0@lo:400: 00000100:00100000:1.0:1790736146.583115:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816079360:0@lo:400: 00000100:00100000:0.0:1790736146.584371:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160838c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877722816079616:12345-0@lo:400: Request processed in 70us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736146.584411:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790736146.584538:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736146.584612:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1877722816079872:0@lo:400: 00000100:00100000:1.0:1790736146.584665:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736146.584696:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790736146.584703:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877722816079488:0@lo:400: 00000100:00100000:1.0:1790736146.584726:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736146.584743:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816080000:0@lo:400: 00000100:00100000:1.0:1790736146.584766:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736146.584803:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816079360 00000100:00100000:1.0:1790736146.584811:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816079360 00000100:00100000:1.0:1790736146.584862:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1790736146.584870:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+19:3308:x1877722816079360:12345-0@lo:400: 00000100:00100000:1.0:1790736146.584925:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+19:3308:x1877722816079360:12345-0@lo:400: Request processed in 55us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736146.584931:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1790736146.584963:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816079872 00000100:00100000:1.0:1790736146.584967:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816079872 00000100:00100000:1.0:1790736146.584988:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816079488 00000100:00100000:1.0:1790736146.584991:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816079488 00000100:00100000:1.0:1790736146.585003:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790736146.585010:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877722816079872:12345-0@lo:400: 00000100:00100000:1.0:1790736146.585044:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877722816079872:12345-0@lo:400: Request processed in 34us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736146.585050:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790736146.585060:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790736146.585066:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877722816079488:12345-0@lo:400: 00000100:00100000:1.0:1790736146.585090:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877722816079488:12345-0@lo:400: Request processed in 25us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736146.585121:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790736146.585143:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816079744 00000100:00100000:1.0:1790736146.585147:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816079744 00000100:00100000:1.0:1790736146.585170:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816080000 00000100:00100000:1.0:1790736146.585173:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816080000 00000100:00100000:1.0:1790736146.585189:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790736146.585195:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160838ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816079744:12345-0@lo:400: 00000100:00100000:1.0:1790736146.585229:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160838ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816079744:12345-0@lo:400: Request processed in 34us (2394us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736146.585236:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790736146.585255:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790736146.585261:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816080000:12345-0@lo:400: 00000100:00080000:0.0:1790736146.585391:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790736146.585397:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790736146.585603:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94162ed92300 x1877722816079744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790736146.585622:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816079744:0@lo:400: 00000100:00100000:3.0:1790736146.594373:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877722816079488:0@lo:400: 00000100:00100000:3.0:1790736146.594405:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816079360:0@lo:400: 00000100:00100000:3.0:1790736146.594439:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1877722816079872:0@lo:400: 00000100:00100000:0.0:1790736146.604329:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1877722816079616:0@lo:400: 00000100:00100000:1.0:1790736146.604890:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816080000:12345-0@lo:400: Request processed in 19624us (20117us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736146.604904:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1790736146.605028:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94160838e680 x1877722816080000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736146.605043:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816080000:0@lo:400: 00000100:00100000:3.0:1790736147.095743:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f240700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816080128:0@lo:13: 00000100:00100000:3.0:1790736147.095850:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736147.095949:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816080128 00000100:00100000:3.0:1790736147.095959:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816080128 00000100:00100000:3.0:1790736147.096018:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790736147.096028:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816080128:12345-0@lo:13: 00002000:00000024:3.0:1790736147.096077:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790736147.096148:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816080128:12345-0@lo:13: Request processed in 121us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736147.096156:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1790736147.096293:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94162f240700 x1877722816080128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736163 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736147.096313:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f240700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816080128:0@lo:13: 00010000:00010000:0.0:1790736147.236335:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736148.245363:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736149.272832:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736150.296579:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790736150.375878:0:8467:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdc89f2c20 20000000:00000080:3.0:1790736150.375903:0:8467:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff94162fa86800 uarg=0000000000000000 20000000:01000000:3.0:1790736150.375944:0:8467:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1790736150.375960:0:8467:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1790736150.375962:0:8467:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1790736150.375967:0:8467:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1790736150.375973:0:8467:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1790736150.375990:0:8467:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1790736150.375993:0:8467:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1790736150.376844:0:8467:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1790736150.376849:0:8467:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1790736150.377873:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1790736150.378372:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1790736150.378443:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1790736150.378499:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1790736150.378516:0:8467:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1790736150.378519:0:8467:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1790736150.379948:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1790736150.381017:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1790736150.381163:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1790736150.381207:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1790736150.381222:0:8467:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1790736150.381225:0:8467:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1790736150.390415:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1790736150.393778:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1790736150.393849:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1790736150.393881:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1790736150.393895:0:8467:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1790736150.393898:0:8467:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1790736150.396692:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1790736150.398700:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1790736150.398766:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1790736150.398832:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:2.0:1790736150.398861:0:8467:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1790736150.398883:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff941611931400/0x6aae200528fe61f7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736150.398903:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94162f8c8600/0x6aae200528fe60f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe60ed expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736150.398911:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff941600030600/0x6aae200528fe611e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe6117 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736150.398919:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff941600030400/0x6aae200528fe6148 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe6141 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736150.398926:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff941611930e00/0x6aae200528fe6156 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe614f expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736150.398933:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff941600030800/0x6aae200528fe6164 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe615d expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736150.399544:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff941600030e00/0x6aae200528fe6180 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe6179 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736150.399551:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff941611931200/0x6aae200528fe61a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe619c expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736150.399560:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff941611930200/0x6aae200528fe61b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526c67 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736150.399568:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94162f8c8400/0x6aae200528fe61bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526c6e expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736150.399576:0:8467:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff941611931400/0x6aae200528fe61f7 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736150.399615:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94162f8c8400/0x6aae200528fe61bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0x92962417a526c6e expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736150.399631:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94162f8c8400/0x6aae200528fe61bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526c6e expref: 9 pid: 5836 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736150.399647:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063ac380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877722816080256:192.168.203.5@tcp:104: 00010000:00010000:2.0:1790736150.399813:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff941611930200/0x6aae200528fe61b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0x92962417a526c67 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736150.399823:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff941611930200/0x6aae200528fe61b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526c67 expref: 9 pid: 5838 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736150.399831:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063ad180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877722816080384:192.168.203.5@tcp:104: 00010000:00010000:2.0:1790736150.399873:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff941611931200/0x6aae200528fe61a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6aae200528fe619c expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736150.399881:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff941611931200/0x6aae200528fe61a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6aae200528fe619c expref: 18 pid: 5836 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736150.399890:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063afb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877722816080512:0@lo:104: 00000100:00100000:2.0:1790736150.399931:0:8467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736150.399983:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816080512 00010000:00010000:2.0:1790736150.399987:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff941600030e00/0x6aae200528fe6180 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6aae200528fe6179 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736150.399993:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816080512 00010000:00010000:2.0:1790736150.399998:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff941600030e00/0x6aae200528fe6180 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6aae200528fe6179 expref: 18 pid: 5838 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736150.400008:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063aed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877722816080640:0@lo:104: 00000100:00100000:2.0:1790736150.400034:0:8467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736150.400061:0:5827:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1790736150.400064:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff941600030800/0x6aae200528fe6164 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6aae200528fe615d expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736150.400072:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816080640 00010000:00010000:2.0:1790736150.400075:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff941600030800/0x6aae200528fe6164 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6aae200528fe615d expref: 18 pid: 5836 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736150.400077:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816080640 00000100:00100000:2.0:1790736150.400088:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063af100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877722816080768:0@lo:104: 00000100:00100000:0.0:1790736150.400116:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790736150.400127:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52e04a2b-4e01-44b7-985c-7db034e22389+4:8467:x1877722816080512:12345-0@lo:104: 00010000:00010000:0.0:1790736150.400139:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff94162f8c9800/0x6aae200528fe619c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe61a3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736150.400153:0:8467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790736150.400179:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff941611930e00/0x6aae200528fe6156 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6aae200528fe614f expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736150.400187:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff941611930e00/0x6aae200528fe6156 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6aae200528fe614f expref: 18 pid: 5838 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.400194:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790736150.400203:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52e04a2b-4e01-44b7-985c-7db034e22389+4:8467:x1877722816080512:12345-0@lo:104: Request processed in 77us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736150.400214:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633e85500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877722816080896:0@lo:104: 00000100:00100000:0.0:1790736150.400215:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790736150.400234:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816080768 00000100:00100000:0.0:1790736150.400238:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816080768 00000100:00100000:2.0:1790736150.400247:0:8467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790736150.400268:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff941600030400/0x6aae200528fe6148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6aae200528fe6141 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736150.400273:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816080896 00000100:00100000:0.0:1790736150.400277:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816080896 00010000:00010000:2.0:1790736150.400278:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff941600030400/0x6aae200528fe6148 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6aae200528fe6141 expref: 18 pid: 5837 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736150.400290:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633e86a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877722816081024:0@lo:104: 00000100:00100000:0.0:1790736150.400294:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790736150.400303:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52e04a2b-4e01-44b7-985c-7db034e22389+5:8467:x1877722816080640:12345-0@lo:104: 00010000:00010000:0.0:1790736150.400311:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff941600031800/0x6aae200528fe6179 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe6180 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736150.400314:0:8467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790736150.400334:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff941600030600/0x6aae200528fe611e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6aae200528fe6117 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736150.400343:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff941600030600/0x6aae200528fe611e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6aae200528fe6117 expref: 18 pid: 5836 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736150.400351:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633e86d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877722816081152:0@lo:104: 00010000:00010000:0.0:1790736150.400356:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790736150.400363:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52e04a2b-4e01-44b7-985c-7db034e22389+5:8467:x1877722816080640:12345-0@lo:104: Request processed in 62us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736150.400369:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790736150.400376:0:8467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790736150.400410:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94162f8c8600/0x6aae200528fe60f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6aae200528fe60ed expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736150.400420:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94162f8c8600/0x6aae200528fe60f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6aae200528fe60ed expref: 18 pid: 5837 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736150.400428:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633e87100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877722816081280:0@lo:104: 00000100:00100000:0.0:1790736150.400436:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816081024 00000100:00100000:0.0:1790736150.400441:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816081024 00000100:00100000:2.0:1790736150.400452:0:8467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736150.400462:0:8467:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162f219e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790736150.400468:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816081152 00000100:00100000:0.0:1790736150.400472:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816081152 00000100:00100000:2.0:1790736150.400483:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063afb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877722816080512:0@lo:104: 00000100:00100000:0.0:1790736150.400484:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816081280 00000100:00100000:0.0:1790736150.400488:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816081280 00000100:00100000:0.0:1790736150.400505:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790736150.400506:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063aed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877722816080640:0@lo:104: 00000100:00100000:0.0:1790736150.400517:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52e04a2b-4e01-44b7-985c-7db034e22389+7:8467:x1877722816080768:12345-0@lo:104: 00010000:00010000:0.0:1790736150.400526:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff941611930800/0x6aae200528fe615d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe6164 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.400569:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1790736150.400579:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52e04a2b-4e01-44b7-985c-7db034e22389+7:8467:x1877722816080768:12345-0@lo:104: Request processed in 61us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736150.400584:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790736150.400596:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790736150.400602:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52e04a2b-4e01-44b7-985c-7db034e22389+6:8467:x1877722816080896:12345-0@lo:104: 00010000:00010000:0.0:1790736150.400609:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe614f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe6156 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.400660:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1790736150.400666:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52e04a2b-4e01-44b7-985c-7db034e22389+6:8467:x1877722816080896:12345-0@lo:104: Request processed in 65us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736150.400672:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790736150.400684:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790736150.400690:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52e04a2b-4e01-44b7-985c-7db034e22389+5:8467:x1877722816081024:12345-0@lo:104: 00010000:00010000:0.0:1790736150.400697:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff94162f8c8e00/0x6aae200528fe6141 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe6148 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.400724:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1790736150.400729:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52e04a2b-4e01-44b7-985c-7db034e22389+5:8467:x1877722816081024:12345-0@lo:104: Request processed in 40us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736150.400734:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790736150.400745:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790736150.400750:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52e04a2b-4e01-44b7-985c-7db034e22389+4:8467:x1877722816081152:12345-0@lo:104: 00010000:00010000:0.0:1790736150.400757:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff94162f8c8000/0x6aae200528fe6117 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe611e expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.400782:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1790736150.400786:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52e04a2b-4e01-44b7-985c-7db034e22389+4:8467:x1877722816081152:12345-0@lo:104: Request processed in 37us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736150.400792:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790736150.400802:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790736150.400808:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52e04a2b-4e01-44b7-985c-7db034e22389+3:8467:x1877722816081280:12345-0@lo:104: 00010000:00010000:0.0:1790736150.400815:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff94162f8c9a00/0x6aae200528fe60ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe60f4 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.400848:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1790736150.400854:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52e04a2b-4e01-44b7-985c-7db034e22389+3:8467:x1877722816081280:12345-0@lo:104: Request processed in 47us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736150.400859:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1790736150.400877:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1790736150.400884:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff94162f8c9800/0x6aae200528fe619c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe61a3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.400891:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c9800 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:0.0:1790736150.400895:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff94162f8c9800/0x6aae200528fe619c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x6aae200528fe61a3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.400904:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff94162f8c9800/0x6aae200528fe619c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x6aae200528fe61a3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790736150.400910:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff94162f8c9800/0x6aae200528fe619c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x6aae200528fe61a3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790736150.400915:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790736150.400944:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff94162f8c9800/0x6aae200528fe619c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe61a3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.400950:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790736150.400970:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff94162f8c9800/0x6aae200528fe619c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe61a3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.400976:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff94162f8c9800/0x6aae200528fe619c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe61a3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.400999:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1790736150.401003:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff941600031800/0x6aae200528fe6179 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe6180 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.401008:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941600031800 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:0.0:1790736150.401011:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff941600031800/0x6aae200528fe6179 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x6aae200528fe6180 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.401017:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff941600031800/0x6aae200528fe6179 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x6aae200528fe6180 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790736150.401022:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff941600031800/0x6aae200528fe6179 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x6aae200528fe6180 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790736150.401028:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790736150.401041:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff941600031800/0x6aae200528fe6179 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe6180 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.401046:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790736150.401060:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff941600031800/0x6aae200528fe6179 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe6180 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.401065:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff941600031800/0x6aae200528fe6179 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe6180 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.401073:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1790736150.401076:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff941611930800/0x6aae200528fe615d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe6164 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.401117:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941611930800 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:0.0:1790736150.401121:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff941611930800/0x6aae200528fe615d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x6aae200528fe6164 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.401128:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff941611930800/0x6aae200528fe615d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x6aae200528fe6164 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790736150.401133:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff941611930800/0x6aae200528fe615d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x6aae200528fe6164 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790736150.401138:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790736150.401152:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff941611930800/0x6aae200528fe615d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe6164 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.401158:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790736150.401163:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff941611930800/0x6aae200528fe615d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe6164 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.401168:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff941611930800/0x6aae200528fe615d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe6164 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.401176:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1790736150.401179:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe614f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe6156 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.401184:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941600030200 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:0.0:1790736150.401186:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe614f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x6aae200528fe6156 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.401202:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe614f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x6aae200528fe6156 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790736150.401208:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe614f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x6aae200528fe6156 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790736150.401214:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790736150.401227:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe614f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe6156 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.401233:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790736150.401238:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe614f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe6156 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.401244:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe614f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe6156 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.401253:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790736150.401256:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff94162f8c8e00/0x6aae200528fe6141 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe6148 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.401261:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c8e00 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:0.0:1790736150.401264:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff94162f8c8e00/0x6aae200528fe6141 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6aae200528fe6148 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.401286:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff94162f8c8e00/0x6aae200528fe6141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6aae200528fe6148 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790736150.401294:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff94162f8c8e00/0x6aae200528fe6141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6aae200528fe6148 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790736150.401304:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790736150.401329:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff94162f8c8e00/0x6aae200528fe6141 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe6148 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.401334:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790736150.401338:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff94162f8c8e00/0x6aae200528fe6141 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe6148 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.401344:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff94162f8c8e00/0x6aae200528fe6141 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe6148 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.401352:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790736150.401354:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff94162f8c8000/0x6aae200528fe6117 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe611e expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.401360:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c8000 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:0.0:1790736150.401363:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff94162f8c8000/0x6aae200528fe6117 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6aae200528fe611e expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.401368:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff94162f8c8000/0x6aae200528fe6117 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6aae200528fe611e expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790736150.401374:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff94162f8c8000/0x6aae200528fe6117 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6aae200528fe611e expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790736150.401379:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790736150.401405:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff94162f8c8000/0x6aae200528fe6117 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe611e expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.401411:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790736150.401422:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff94162f8c8000/0x6aae200528fe6117 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe611e expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.401428:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff94162f8c8000/0x6aae200528fe6117 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe611e expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.401436:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790736150.401439:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff94162f8c9a00/0x6aae200528fe60ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe60f4 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.401445:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c9a00 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:0.0:1790736150.401448:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff94162f8c9a00/0x6aae200528fe60ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6aae200528fe60f4 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.401454:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff94162f8c9a00/0x6aae200528fe60ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6aae200528fe60f4 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790736150.401460:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff94162f8c9a00/0x6aae200528fe60ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6aae200528fe60f4 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790736150.401465:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790736150.401478:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff94162f8c9a00/0x6aae200528fe60ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe60f4 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.401484:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790736150.401487:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff94162f8c9a00/0x6aae200528fe60ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe60f4 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.401493:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff94162f8c9a00/0x6aae200528fe60ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe60f4 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.401508:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736150.401515:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736150.401516:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790736150.401537:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52e04a2b-4e01-44b7-985c-7db034e22389:3307:1877722816081408:0@lo:103: 00000100:00100000:0.0:1790736150.401583:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736150.401609:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52e04a2b-4e01-44b7-985c-7db034e22389:3307:1877722816081920:0@lo:103: 00000100:00100000:0.0:1790736150.401628:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736150.401650:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790736150.401656:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52e04a2b-4e01-44b7-985c-7db034e22389:3307:1877722816081792:0@lo:103: 00000100:00100000:0.0:1790736150.401675:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736150.401704:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52e04a2b-4e01-44b7-985c-7db034e22389:3309:1877722816081664:0@lo:103: 00000100:00100000:0.0:1790736150.401725:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736150.401735:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52e04a2b-4e01-44b7-985c-7db034e22389:3309:1877722816082176:0@lo:103: 00000100:00100000:0.0:1790736150.401752:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736150.401763:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1790736150.401768:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52e04a2b-4e01-44b7-985c-7db034e22389:3309:1877722816081536:0@lo:103: 00000100:00100000:0.0:1790736150.401787:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736150.401796:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52e04a2b-4e01-44b7-985c-7db034e22389:3309:1877722816082048:0@lo:103: 00000100:00100000:0.0:1790736150.401816:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736150.401837:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816081408 00000100:00100000:0.0:1790736150.401843:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816081408 00010000:00010000:0.0:1790736150.401869:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff941611931200/0x6aae200528fe61a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe619c expref: 19 pid: 5836 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736150.401886:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816081920 00000100:00100000:0.0:1790736150.401890:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816081920 00010000:00010000:0.0:1790736150.401900:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff941600030400/0x6aae200528fe6148 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe6141 expref: 20 pid: 5837 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736150.401924:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816081792 00000100:00100000:0.0:1790736150.401927:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816081792 00010000:00010000:0.0:1790736150.401939:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff941611930e00/0x6aae200528fe6156 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe614f expref: 21 pid: 5838 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736150.401946:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816081664 00000100:00100000:0.0:1790736150.401948:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816081664 00010000:00010000:0.0:1790736150.401958:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff941600030800/0x6aae200528fe6164 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe615d expref: 22 pid: 5836 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736150.402379:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816082176 00000100:00100000:0.0:1790736150.402393:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816082176 00010000:00010000:0.0:1790736150.402409:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94162f8c8600/0x6aae200528fe60f4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe60ed expref: 23 pid: 5837 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736150.402421:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816081536 00000100:00100000:0.0:1790736150.402423:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816081536 00010000:00010000:0.0:1790736150.402431:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff941600030e00/0x6aae200528fe6180 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe6179 expref: 24 pid: 5838 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736150.402440:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816082048 00000100:00100000:0.0:1790736150.402442:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816082048 00010000:00010000:0.0:1790736150.402508:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff941600030600/0x6aae200528fe611e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe6117 expref: 25 pid: 5836 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736150.402522:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790736150.402529:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52e04a2b-4e01-44b7-985c-7db034e22389+25:3307:x1877722816081408:12345-0@lo:103: 00010000:00010000:0.0:1790736150.402540:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790736150.402546:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff941611931200/0x6aae200528fe61a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe619c expref: 25 pid: 5836 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.402568:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff941611931200/0x6aae200528fe61a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6aae200528fe619c expref: 25 pid: 5836 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.402582:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941611931200/0x6aae200528fe61a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6aae200528fe619c expref: 25 pid: 5836 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.402594:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790736150.402641:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52e04a2b-4e01-44b7-985c-7db034e22389+24:3307:x1877722816081408:12345-0@lo:103: Request processed in 112us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736150.402648:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790736150.402666:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790736150.402671:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52e04a2b-4e01-44b7-985c-7db034e22389+23:3307:x1877722816081920:12345-0@lo:103: 00010000:00010000:0.0:1790736150.402679:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790736150.402684:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff941600030400/0x6aae200528fe6148 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe6141 expref: 23 pid: 5837 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.402691:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff941600030400/0x6aae200528fe6148 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6aae200528fe6141 expref: 23 pid: 5837 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.402700:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790736150.402722:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52e04a2b-4e01-44b7-985c-7db034e22389+23:3307:x1877722816081920:12345-0@lo:103: Request processed in 51us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736150.402727:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790736150.402737:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790736150.402743:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52e04a2b-4e01-44b7-985c-7db034e22389+22:3307:x1877722816081792:12345-0@lo:103: 00010000:00010000:0.0:1790736150.402751:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790736150.402754:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff941611930e00/0x6aae200528fe6156 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe614f expref: 22 pid: 5838 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.402767:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff941611930e00/0x6aae200528fe6156 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6aae200528fe614f expref: 22 pid: 5838 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.402776:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790736150.402798:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52e04a2b-4e01-44b7-985c-7db034e22389+22:3307:x1877722816081792:12345-0@lo:103: Request processed in 55us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736150.402804:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790736150.402817:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790736150.402823:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52e04a2b-4e01-44b7-985c-7db034e22389+21:3309:x1877722816081664:12345-0@lo:103: 00010000:00010000:0.0:1790736150.402829:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790736150.402835:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff941600030800/0x6aae200528fe6164 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe615d expref: 21 pid: 5836 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.402843:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff941600030800/0x6aae200528fe6164 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6aae200528fe615d expref: 21 pid: 5836 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.402852:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790736150.402907:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941600030800/0x6aae200528fe6164 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6aae200528fe615d expref: 21 pid: 5836 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736150.402918:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063af100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877722816080768:0@lo:104: 00000100:00100000:0.0:1790736150.403706:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52e04a2b-4e01-44b7-985c-7db034e22389+20:3309:x1877722816081664:12345-0@lo:103: Request processed in 878us (1974us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736150.403715:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790736150.403734:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790736150.403742:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52e04a2b-4e01-44b7-985c-7db034e22389+19:3309:x1877722816082176:12345-0@lo:103: 00010000:00010000:0.0:1790736150.403753:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790736150.403760:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94162f8c8600/0x6aae200528fe60f4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe60ed expref: 19 pid: 5837 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.403768:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94162f8c8600/0x6aae200528fe60f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6aae200528fe60ed expref: 19 pid: 5837 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.403790:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790736150.403826:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52e04a2b-4e01-44b7-985c-7db034e22389+19:3309:x1877722816082176:12345-0@lo:103: Request processed in 85us (2072us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736150.403831:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790736150.403846:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790736150.403851:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52e04a2b-4e01-44b7-985c-7db034e22389+18:3309:x1877722816081536:12345-0@lo:103: 00010000:00010000:0.0:1790736150.403858:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790736150.403863:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff941600030e00/0x6aae200528fe6180 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe6179 expref: 18 pid: 5838 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.403870:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff941600030e00/0x6aae200528fe6180 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6aae200528fe6179 expref: 18 pid: 5838 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.403880:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941600030e00/0x6aae200528fe6180 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6aae200528fe6179 expref: 18 pid: 5838 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.403888:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790736150.403911:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52e04a2b-4e01-44b7-985c-7db034e22389+17:3309:x1877722816081536:12345-0@lo:103: Request processed in 60us (2123us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736150.403917:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790736150.403929:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790736150.403935:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160557f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52e04a2b-4e01-44b7-985c-7db034e22389+16:3309:x1877722816082048:12345-0@lo:103: 00010000:00010000:0.0:1790736150.403942:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790736150.403947:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff941600030600/0x6aae200528fe611e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe6117 expref: 16 pid: 5836 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.403954:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff941600030600/0x6aae200528fe611e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6aae200528fe6117 expref: 16 pid: 5836 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736150.403970:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790736150.403995:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160557f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52e04a2b-4e01-44b7-985c-7db034e22389+16:3309:x1877722816082048:12345-0@lo:103: Request processed in 60us (2178us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736150.404001:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1790736150.406896:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941611930e00/0x6aae200528fe6156 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6aae200528fe614f expref: 15 pid: 5838 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736150.406921:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633e85500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877722816080896:0@lo:104: 00010000:00010000:1.0:1790736150.407359:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736150.407618:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941600030400/0x6aae200528fe6148 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6aae200528fe6141 expref: 14 pid: 5837 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736150.407632:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633e86a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877722816081024:0@lo:104: 00010000:00010000:3.0:1790736150.407643:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941600030600/0x6aae200528fe611e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6aae200528fe6117 expref: 13 pid: 5836 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736150.407650:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633e86d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877722816081152:0@lo:104: 00010000:00010000:3.0:1790736150.407659:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94162f8c8600/0x6aae200528fe60f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6aae200528fe60ed expref: 12 pid: 5837 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736150.407667:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633e87100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877722816081280:0@lo:104: 00000100:00100000:2.0:1790736150.408404:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52e04a2b-4e01-44b7-985c-7db034e22389:3307:1877722816081792:0@lo:103: 00000100:00100000:2.0:1790736150.408418:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52e04a2b-4e01-44b7-985c-7db034e22389:3307:1877722816081408:0@lo:103: 00000100:00100000:2.0:1790736150.408426:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52e04a2b-4e01-44b7-985c-7db034e22389:3307:1877722816081920:0@lo:103: 00000100:00100000:0.0:1790736150.409273:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52e04a2b-4e01-44b7-985c-7db034e22389:3309:1877722816081536:0@lo:103: 00000100:00100000:0.0:1790736150.409288:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52e04a2b-4e01-44b7-985c-7db034e22389:3309:1877722816082048:0@lo:103: 00000100:00100000:0.0:1790736150.409296:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52e04a2b-4e01-44b7-985c-7db034e22389:3309:1877722816081664:0@lo:103: 00000100:00100000:0.0:1790736150.409302:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52e04a2b-4e01-44b7-985c-7db034e22389:3309:1877722816082176:0@lo:103: 00000100:00100000:3.0:1790736150.411511:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063ac380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877722816080256:192.168.203.5@tcp:104: 00000100:00100000:3.0:1790736150.411525:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063ad180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877722816080384:192.168.203.5@tcp:104: 00010000:00010000:3.0:1790736150.411573:0:8467:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff941611931400/0x6aae200528fe61f7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736150.415507:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736150.415549:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736150.415623:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797182976 00000100:00100000:2.0:1790736150.415633:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797182976 00010000:00010000:2.0:1790736150.415675:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94162f8c8400/0x6aae200528fe61bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526c6e expref: 10 pid: 5836 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736150.415714:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797183104 00000100:00100000:2.0:1790736150.415718:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797183104 00010000:00010000:2.0:1790736150.415730:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff941611930200/0x6aae200528fe61b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526c67 expref: 11 pid: 5838 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736150.415746:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 19 00000100:00100000:2.0:1790736150.415755:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f240700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:637df299-95a2-42b2-90c0-64260eee1701+11:2356:x1877722797182976:12345-192.168.203.5@tcp:103: 00010000:00010000:2.0:1790736150.415773:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790736150.415779:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94162f8c8400/0x6aae200528fe61bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526c6e expref: 11 pid: 5836 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736150.415808:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94162f8c8400/0x6aae200528fe61bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526c6e expref: 11 pid: 5836 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736150.415828:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94162f8c8400/0x6aae200528fe61bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526c6e expref: 11 pid: 5836 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736150.415848:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790736150.415903:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f240700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:637df299-95a2-42b2-90c0-64260eee1701+10:2356:x1877722797182976:12345-192.168.203.5@tcp:103: Request processed in 149us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736150.415911:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 19 00000100:00100000:2.0:1790736150.415932:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 20 00000100:00100000:2.0:1790736150.415939:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f241500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:637df299-95a2-42b2-90c0-64260eee1701+9:2356:x1877722797183104:12345-192.168.203.5@tcp:103: 00010000:00010000:2.0:1790736150.416021:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790736150.416027:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff941611930200/0x6aae200528fe61b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526c67 expref: 9 pid: 5838 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736150.416036:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff941611930200/0x6aae200528fe61b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526c67 expref: 9 pid: 5838 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736150.416045:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941611930200/0x6aae200528fe61b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526c67 expref: 9 pid: 5838 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736150.416057:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff941611931400/0x6aae200528fe61f7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736150.416066:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941611931400/0x6aae200528fe61f7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736150.416116:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff941611931400/0x6aae200528fe61f7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736150.416125:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff941611931400/0x6aae200528fe61f7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736150.416132:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff941611931400/0x6aae200528fe61f7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736150.416139:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff941611931400/0x6aae200528fe61f7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736150.416145:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941611931400 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:2.0:1790736150.416149:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff941611931400/0x6aae200528fe61f7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736150.416157:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff941611931400/0x6aae200528fe61f7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736150.416169:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff941611931400/0x6aae200528fe61f7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736150.416179:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790736150.416200:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f241500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:637df299-95a2-42b2-90c0-64260eee1701+8:2356:x1877722797183104:12345-192.168.203.5@tcp:103: Request processed in 262us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736150.416208:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 20 00010000:00010000:3.0:1790736150.416290:0:8467:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff941611931400/0x6aae200528fe61f7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736150.416299:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff941611931400/0x6aae200528fe61f7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736150.416305:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941611931400/0x6aae200528fe61f7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736150.534520:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736150.534552:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736150.534589:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736150.535951:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797183488 00000100:00100000:3.0:1790736150.535965:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797183488 00000100:00100000:3.0:1790736150.536030:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797183360 00000100:00100000:3.0:1790736150.536034:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797183360 00000100:00100000:3.0:1790736150.536057:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 13 00000100:00100000:3.0:1790736150.536067:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162edc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2354:x1877722797183488:12345-192.168.203.5@tcp:400: 00000100:00100000:3.0:1790736150.536163:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162edc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2354:x1877722797183488:12345-192.168.203.5@tcp:400: Request processed in 97us (1609us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736150.536171:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 13 00000100:00100000:3.0:1790736150.536187:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 14 00000100:00100000:3.0:1790736150.536193:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162edc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2354:x1877722797183360:12345-192.168.203.5@tcp:400: 00000100:00100000:3.0:1790736150.536215:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162edc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2354:x1877722797183360:12345-192.168.203.5@tcp:400: Request processed in 22us (1627us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736150.536222:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 14 00000100:00080000:3.0:1790736150.536240:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790736150.536243:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790736150.536498:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797183232 00000100:00100000:0.0:1790736150.536504:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797183232 00000100:00100000:0.0:1790736150.536553:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 29 00000100:00100000:0.0:1790736150.536561:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162edc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2354:x1877722797183232:12345-192.168.203.5@tcp:400: 00000100:00100000:0.0:1790736150.536592:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162edc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2354:x1877722797183232:12345-192.168.203.5@tcp:400: Request processed in 33us (2079us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736150.536599:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 29 00000100:00080000:3.0:1790736150.536702:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790736150.689730:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816082304:0@lo:13: 00000100:00100000:3.0:1790736150.689797:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736150.691617:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816082304 00000100:00100000:0.0:1790736150.691633:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816082304 00000100:00100000:0.0:1790736150.691710:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790736150.691719:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f240380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816082304:12345-0@lo:13: 00002000:00000024:0.0:1790736150.691759:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790736150.696648:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f240380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816082304:12345-0@lo:13: Request processed in 4918us (6838us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736150.696667:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1790736150.696710:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790736150.696940:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163fad7480 x1877722816082304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736166 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736150.696969:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816082304:0@lo:13: 00010000:00010000:0.0:1790736151.321375:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736151.701549:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f241c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816082816:0@lo:400: 00000100:00100000:3.0:1790736151.701623:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736151.701712:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1790736151.701719:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f242a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816082432:0@lo:400: 00000100:00100000:3.0:1790736151.701752:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736151.701772:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f243100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1877722816082944:0@lo:400: 00000100:00100000:3.0:1790736151.701794:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736151.701880:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877722816082560:0@lo:400: 00000100:00100000:2.0:1790736151.701914:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736151.701952:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f240e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816083072:0@lo:400: 00000100:00100000:2.0:1790736151.701995:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736151.702016:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790736151.702021:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f242d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1877722816082688:0@lo:400: 00000100:00100000:2.0:1790736151.702040:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736151.702070:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816082816 00000100:00100000:2.0:1790736151.702080:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816082816 00000100:00100000:2.0:1790736151.702167:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816083072 00000100:00100000:2.0:1790736151.702170:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816083072 00000100:00100000:2.0:1790736151.702199:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790736151.702210:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816082816:12345-0@lo:400: 00000100:00100000:2.0:1790736151.702266:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816082816:12345-0@lo:400: Request processed in 58us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736151.702273:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790736151.702291:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790736151.702296:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816083072:12345-0@lo:400: 00000100:00100000:2.0:1790736151.702323:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816083072:12345-0@lo:400: Request processed in 26us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736151.702328:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1790736151.702385:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94162f240e00 x1877722816083072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790736151.702400:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f240e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816083072:0@lo:400: 00010000:00080000:2.0:1790736151.702436:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94162f241c00 x1877722816082816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790736151.702445:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f241c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816082816:0@lo:400: 00000100:00100000:0.0:1790736151.702628:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816082944 00000100:00100000:0.0:1790736151.702633:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816082944 00000100:00100000:0.0:1790736151.702669:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816082560 00000100:00100000:0.0:1790736151.702672:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816082560 00000100:00100000:0.0:1790736151.702684:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816082688 00000100:00100000:0.0:1790736151.702685:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816082688 00000100:00100000:0.0:1790736151.702699:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790736151.702706:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877722816082944:12345-0@lo:400: 00000100:00100000:0.0:1790736151.702745:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877722816082944:12345-0@lo:400: Request processed in 40us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736151.702752:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790736151.702763:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790736151.702767:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877722816082560:12345-0@lo:400: 00000100:00100000:0.0:1790736151.702792:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877722816082560:12345-0@lo:400: Request processed in 25us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736151.702797:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790736151.702806:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790736151.702811:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877722816082688:12345-0@lo:400: 00000100:00100000:0.0:1790736151.702833:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877722816082688:12345-0@lo:400: Request processed in 22us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736151.702838:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1790736151.702856:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790736151.702860:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790736151.703034:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816082432 00000100:00100000:1.0:1790736151.703039:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816082432 00000100:00100000:1.0:1790736151.703078:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1790736151.703086:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+12:3306:x1877722816082432:12345-0@lo:400: 00000100:00100000:1.0:1790736151.703144:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+12:3306:x1877722816082432:12345-0@lo:400: Request processed in 58us (1390us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736151.703151:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1790736151.703295:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f242d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1877722816082688:0@lo:400: 00000100:00100000:2.0:1790736151.703307:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877722816082560:0@lo:400: 00000100:00100000:2.0:1790736151.703347:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f242a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816082432:0@lo:400: 00000100:00100000:2.0:1790736151.703358:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f243100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1877722816082944:0@lo:400: 10000000:01000000:3.0:1790736152.021275:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790736152.021282:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94162d364800 from 39 10000000:01000000:3.0:1790736152.021287:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790736152.021337:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c8600/0x6aae200528fe61fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736152.021350:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff94162f8c8600/0x6aae200528fe61fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736152.021361:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff94162f8c8600/0x6aae200528fe61fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736152.021394:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f240a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816083200:0@lo:101: 00000100:00100000:3.0:1790736152.021464:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736152.021552:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607c030c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790736152.021733:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816083200 00000100:00100000:0.0:1790736152.021743:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816083200 00000100:00100000:0.0:1790736152.021801:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1790736152.021811:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+12:5841:x1877722816083200:12345-0@lo:101: 00010000:00010000:0.0:1790736152.021836:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736152.021852:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941600030e00/0x6aae200528fe6205 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe61fe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736152.021876:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941600030e00/0x6aae200528fe6205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe61fe expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736152.021889:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941600030e00/0x6aae200528fe6205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe61fe expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736152.021898:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941600030e00, rc 0) 00000100:00100000:0.0:1790736152.021962:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+13:5841:x1877722816083200:12345-0@lo:101: Request processed in 153us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736152.021970:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1790736152.022206:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f240a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816083200:0@lo:101: 00010000:00010000:3.0:1790736152.022222:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff94162f8c8600/0x6aae200528fe61fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6205 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736152.022296:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff94162f8c8600/0x6aae200528fe61fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe6205 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736152.022351:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f240a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816083328:0@lo:501: 00000100:00100000:3.0:1790736152.022391:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736152.022425:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607c030c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790736152.022527:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816083328 00000100:00100000:0.0:1790736152.022532:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816083328 00000100:00100000:0.0:1790736152.022560:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1790736152.022568:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+13:5841:x1877722816083328:12345-0@lo:501: 00000100:00100000:0.0:1790736152.022819:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+13:5841:x1877722816083328:12345-0@lo:501: Request processed in 251us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736152.022826:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1790736152.024038:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f240a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816083328:0@lo:501: 00000100:00100000:3.0:1790736152.024135:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f240a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816083456:0@lo:503: 00000100:00100000:3.0:1790736152.024203:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736152.024434:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607c030c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790736152.025091:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816083456 00000100:00100000:0.0:1790736152.025131:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816083456 00000100:00100000:0.0:1790736152.025197:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1790736152.025206:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+13:5841:x1877722816083456:12345-0@lo:503: 00000100:00100000:0.0:1790736152.025434:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+13:5841:x1877722816083456:12345-0@lo:503: Request processed in 228us (1229us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736152.025442:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1790736152.025605:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f240a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816083456:0@lo:503: 00000100:00100000:3.0:1790736152.027372:0:8483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f240a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:8483:1877722816083584:0@lo:502: 00000100:00100000:3.0:1790736152.027470:0:8483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736152.027519:0:8483:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607c033c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790736152.027653:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816083584 00000100:00100000:0.0:1790736152.027662:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816083584 00000100:00100000:0.0:1790736152.027712:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1790736152.027721:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+13:8483:x1877722816083584:12345-0@lo:502: 00000100:00100000:0.0:1790736152.027982:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+13:8483:x1877722816083584:12345-0@lo:502: Request processed in 261us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736152.027989:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1790736152.029406:0:8483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f240a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:8483:1877722816083584:0@lo:502: 00000100:00100000:3.0:1790736152.029485:0:8483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f240a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:8483:1877722816083712:0@lo:502: 00000100:00100000:3.0:1790736152.029545:0:8483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736152.029592:0:8483:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607c033c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790736152.030053:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816083712 00000100:00100000:1.0:1790736152.030070:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816083712 00000100:00100000:1.0:1790736152.030160:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1790736152.030171:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+13:8483:x1877722816083712:12345-0@lo:502: 00000100:00100000:1.0:1790736152.030793:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+13:8483:x1877722816083712:12345-0@lo:502: Request processed in 622us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736152.030800:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1790736152.032045:0:8483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f240a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:8483:1877722816083712:0@lo:502: 00000040:00080000:3.0:1790736152.032129:0:8483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1790736152.032370:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1790736152.032405:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790736152.032417:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c8600/0x6aae200528fe61fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6205 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736152.032429:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff94162f8c8600/0x6aae200528fe61fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6205 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790736152.032441:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1790736152.032444:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1790736152.032448:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1790736152.032490:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe620c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736152.032498:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe620c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736152.032508:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe620c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736152.032528:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fad4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816083840:0@lo:101: 00000100:00100000:0.0:1790736152.032583:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736152.032631:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416106f3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790736152.032712:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816083840 00000100:00100000:2.0:1790736152.032719:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816083840 00000100:00100000:2.0:1790736152.032765:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1790736152.032773:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+13:5841:x1877722816083840:12345-0@lo:101: 00010000:00010000:2.0:1790736152.032789:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736152.032803:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941611930200/0x6aae200528fe6213 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe620c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736152.032824:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941611930200/0x6aae200528fe6213 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe620c expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736152.032834:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941611930200/0x6aae200528fe6213 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe620c expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736152.032842:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611930200, rc 0) 00000100:00100000:2.0:1790736152.032882:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+14:5841:x1877722816083840:12345-0@lo:101: Request processed in 110us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736152.032888:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1790736152.033039:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fad4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816083840:0@lo:101: 00010000:00010000:0.0:1790736152.033051:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe620c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6213 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736152.034411:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe620c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe6213 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736152.034497:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fad4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816083968:0@lo:501: 00000100:00100000:0.0:1790736152.036326:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736152.036405:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416106f3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790736152.036991:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816083968 00000100:00100000:3.0:1790736152.037016:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816083968 00000100:00100000:3.0:1790736152.037080:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1790736152.037090:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+14:5841:x1877722816083968:12345-0@lo:501: 00000100:00100000:3.0:1790736152.037642:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+14:5841:x1877722816083968:12345-0@lo:501: Request processed in 553us (2586us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736152.037650:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1790736152.041337:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fad4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816083968:0@lo:501: 00000100:00100000:0.0:1790736152.041416:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fad4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816084096:0@lo:503: 00000100:00100000:0.0:1790736152.041509:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736152.041568:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416106f3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790736152.042333:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816084096 00000100:00100000:1.0:1790736152.042343:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816084096 00000100:00100000:1.0:1790736152.042408:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1790736152.042425:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+14:5841:x1877722816084096:12345-0@lo:503: 00000100:00100000:1.0:1790736152.042638:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+14:5841:x1877722816084096:12345-0@lo:503: Request processed in 214us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736152.042646:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1790736152.044893:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fad4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816084096:0@lo:503: 00000100:00100000:0.0:1790736152.046915:0:8484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fad4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:8484:1877722816084224:0@lo:502: 00000100:00100000:0.0:1790736152.047004:0:8484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736152.047068:0:8484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416106f3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790736152.047242:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816084224 00000100:00100000:2.0:1790736152.047250:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816084224 00000100:00100000:2.0:1790736152.047294:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1790736152.047304:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+14:8484:x1877722816084224:12345-0@lo:502: 00000100:00100000:2.0:1790736152.047527:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+14:8484:x1877722816084224:12345-0@lo:502: Request processed in 225us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736152.047535:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1790736152.048023:0:8484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fad4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:8484:1877722816084224:0@lo:502: 00000020:01000000:0.0:1790736152.048068:0:8484:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790736152.048079:0:8484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790736152.048082:0:8484:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790736152.048087:0:8484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1790736152.051337:0:8484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:8484:1877722816084352:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790736152.052658:0:8484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736152.052722:0:8484:0:(client.c:2716:ptlrpc_set_wait()) set ffff941635cc2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790736152.053029:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816084352 00000100:00100000:2.0:1790736152.053038:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816084352 00000100:00100000:2.0:1790736152.053198:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1790736152.053208:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+14:8484:x1877722816084352:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790736152.053488:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+14:8484:x1877722816084352:12345-0@lo:502:llog_process_th.0 Request processed in 281us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736152.053497:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1790736152.053586:0:8484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:8484:1877722816084352:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790736152.053614:0:8484:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790736152.053621:0:8484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790736152.053623:0:8484:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790736152.053627:0:8484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1790736152.054315:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1790736152.054336:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1790736152.054346:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe620c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6213 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736152.054366:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe620c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6213 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790736152.054387:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790736152.054390:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94162d353800 from 39 10000000:01000000:0.0:1790736152.054392:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790736152.054439:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff941600031800/0x6aae200528fe621a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736152.054448:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff941600031800/0x6aae200528fe621a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736152.054457:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff941600031800/0x6aae200528fe621a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736152.054479:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fad4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816084480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790736152.054525:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736152.054972:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416106f3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790736152.055055:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816084480 00000100:00100000:3.0:1790736152.055062:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816084480 00000100:00100000:3.0:1790736152.055122:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1790736152.055141:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+14:5841:x1877722816084480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790736152.055154:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736152.055167:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94162f8c9600/0x6aae200528fe6221 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe621a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736152.055190:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94162f8c9600/0x6aae200528fe6221 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe621a expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736152.055201:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94162f8c9600/0x6aae200528fe6221 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe621a expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736152.055209:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c9600, rc 0) 00000100:00100000:3.0:1790736152.055264:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+15:5841:x1877722816084480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736152.055271:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1790736152.056054:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fad4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816084480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790736152.056076:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff941600031800/0x6aae200528fe621a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6221 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736152.056086:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff941600031800/0x6aae200528fe621a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe6221 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736152.056173:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fad4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816084608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790736152.056214:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736152.056283:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416106f3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790736152.056345:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816084608 00000100:00100000:2.0:1790736152.056352:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816084608 00000100:00100000:2.0:1790736152.056396:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1790736152.056404:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+15:5841:x1877722816084608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790736152.056679:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+15:5841:x1877722816084608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 276us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736152.056687:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1790736152.056965:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fad4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816084608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790736152.056993:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fad4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816084736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790736152.057030:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736152.057064:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416106f3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790736152.057236:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816084736 00000100:00100000:2.0:1790736152.057242:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816084736 00000100:00100000:2.0:1790736152.057273:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1790736152.057280:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+15:5841:x1877722816084736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790736152.057548:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+15:5841:x1877722816084736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 268us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736152.057555:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1790736152.057640:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fad4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816084736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790736152.058203:0:8485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f240a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:8485:1877722816084864:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790736152.058270:0:8485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736152.058305:0:8485:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607c03480 going to sleep for 11 seconds 00000100:00100000:0.0:1790736152.058363:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816084864 00000100:00100000:0.0:1790736152.058368:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816084864 00000100:00100000:0.0:1790736152.058412:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1790736152.058419:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+15:8485:x1877722816084864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790736152.058621:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+15:8485:x1877722816084864:12345-0@lo:502:llog_process_th.0 Request processed in 202us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736152.058628:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1790736152.058951:0:8485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f240a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:8485:1877722816084864:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790736152.059006:0:8485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f240a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:8485:1877722816084992:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790736152.059042:0:8485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736152.059056:0:8485:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607c03480 going to sleep for 11 seconds 00000100:00100000:2.0:1790736152.059125:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816084992 00000100:00100000:2.0:1790736152.059130:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816084992 00000100:00100000:2.0:1790736152.059150:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1790736152.059157:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+15:8485:x1877722816084992:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790736152.059318:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+15:8485:x1877722816084992:12345-0@lo:502:llog_process_th.0 Request processed in 160us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736152.059330:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1790736152.059736:0:8485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f240a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:8485:1877722816084992:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1790736152.059757:0:8485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1790736152.062946:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1790736152.062991:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790736152.063007:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff941600031800/0x6aae200528fe621a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6221 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736152.063022:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff941600031800/0x6aae200528fe621a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6221 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790736152.063035:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1790736152.063037:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1790736152.063041:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1790736152.063107:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162156e200/0x6aae200528fe6228 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736152.063117:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff94162156e200/0x6aae200528fe6228 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736152.063159:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff94162156e200/0x6aae200528fe6228 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736152.063184:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816085120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790736152.063418:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736152.063578:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941635cc2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790736152.063670:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816085120 00000100:00100000:2.0:1790736152.063679:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816085120 00000100:00100000:2.0:1790736152.063731:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1790736152.063740:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+15:5841:x1877722816085120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790736152.063755:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736152.063768:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941611930e00/0x6aae200528fe622f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe6228 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736152.063792:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941611930e00/0x6aae200528fe622f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe6228 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736152.063803:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941611930e00/0x6aae200528fe622f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe6228 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736152.063812:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611930e00, rc 0) 00000100:00100000:2.0:1790736152.064210:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+16:5841:x1877722816085120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 470us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736152.064218:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1790736152.064481:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816085120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790736152.064499:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff94162156e200/0x6aae200528fe6228 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe622f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736152.064509:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff94162156e200/0x6aae200528fe6228 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe622f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736152.064577:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fad4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816085248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790736152.064611:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736152.064649:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416106f3000 going to sleep for 11 seconds 00000100:00100000:1.0:1790736152.064998:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816085248 00000100:00100000:1.0:1790736152.065005:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816085248 00000100:00100000:1.0:1790736152.065044:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1790736152.065051:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+16:5841:x1877722816085248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790736152.065548:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+16:5841:x1877722816085248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 495us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736152.065556:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1790736152.065632:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fad4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816085248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790736152.065665:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fad4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816085376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790736152.065711:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736152.065744:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416106f3000 going to sleep for 11 seconds 00000100:00100000:2.0:1790736152.065804:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816085376 00000100:00100000:2.0:1790736152.065809:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816085376 00000100:00100000:2.0:1790736152.065915:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1790736152.065923:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+16:5841:x1877722816085376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790736152.066069:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+16:5841:x1877722816085376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736152.066076:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1790736152.066259:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fad4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816085376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790736152.067267:0:8486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fad4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:8486:1877722816085504:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790736152.067334:0:8486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736152.067366:0:8486:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416106f3780 going to sleep for 11 seconds 00000100:00100000:2.0:1790736152.067802:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816085504 00000100:00100000:2.0:1790736152.067828:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816085504 00000100:00100000:2.0:1790736152.067876:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1790736152.067883:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+16:8486:x1877722816085504:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790736152.068165:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+16:8486:x1877722816085504:12345-0@lo:502:llog_process_th.0 Request processed in 282us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736152.068173:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1790736152.068474:0:8486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fad4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:8486:1877722816085504:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790736152.068503:0:8486:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790736152.068512:0:8486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790736152.068514:0:8486:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790736152.068520:0:8486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1790736152.068545:0:8486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:8486:1877722816085632:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790736152.068583:0:8486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736152.068608:0:8486:0:(client.c:2716:ptlrpc_set_wait()) set ffff941635cc2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790736152.068714:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816085632 00000100:00100000:2.0:1790736152.068719:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816085632 00000100:00100000:2.0:1790736152.068752:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1790736152.068758:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+16:8486:x1877722816085632:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790736152.068998:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+16:8486:x1877722816085632:12345-0@lo:502:llog_process_th.0 Request processed in 240us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736152.069004:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1790736152.069079:0:8486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:8486:1877722816085632:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790736152.069122:0:8486:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790736152.069127:0:8486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790736152.069137:0:8486:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790736152.069142:0:8486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1790736152.069418:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1790736152.069511:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1790736152.069521:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162156e200/0x6aae200528fe6228 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe622f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736152.069532:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff94162156e200/0x6aae200528fe6228 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe622f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790736152.069543:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790736152.069546:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff941604c0d800 from 39 10000000:01000000:2.0:1790736152.069548:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790736152.069577:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff941611931400/0x6aae200528fe6236 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736152.069584:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff941611931400/0x6aae200528fe6236 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736152.069601:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff941611931400/0x6aae200528fe6236 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736152.069616:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633e85f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816085760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790736152.069648:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736152.069686:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162f219d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790736152.069760:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816085760 00000100:00100000:0.0:1790736152.069765:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816085760 00000100:00100000:0.0:1790736152.069799:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1790736152.069806:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+16:5841:x1877722816085760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790736152.069827:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736152.069839:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941600031a00/0x6aae200528fe623d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe6236 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736152.069861:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941600031a00/0x6aae200528fe623d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe6236 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736152.069871:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941600031a00/0x6aae200528fe623d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe6236 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736152.069878:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941600031a00, rc 0) 00000100:00100000:0.0:1790736152.069910:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+17:5841:x1877722816085760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736152.069916:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1790736152.070054:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633e85f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816085760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790736152.070067:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff941611931400/0x6aae200528fe6236 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe623d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736152.070076:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff941611931400/0x6aae200528fe6236 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe623d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736152.070579:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633e85f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816085888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790736152.070612:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736152.070633:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162f219d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790736152.070647:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816085888 00000100:00100000:2.0:1790736152.070651:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816085888 00000100:00100000:2.0:1790736152.070670:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1790736152.070677:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+17:5841:x1877722816085888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790736152.071565:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+17:5841:x1877722816085888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 882us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736152.071576:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1790736152.071671:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633e85f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816085888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790736152.071712:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fad7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816086016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790736152.071764:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736152.071801:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416106f3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790736152.071915:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816086016 00000100:00100000:1.0:1790736152.071920:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816086016 00000100:00100000:1.0:1790736152.071961:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1790736152.071969:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606656850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+17:5841:x1877722816086016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790736152.072398:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606656850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+17:5841:x1877722816086016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 429us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736152.072405:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1790736152.074581:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fad7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816086016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790736152.075704:0:8487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633e85880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:8487:1877722816086144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790736152.075791:0:8487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736152.075953:0:8487:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162f219f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790736152.076004:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816086144 00000100:00100000:1.0:1790736152.076011:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816086144 00000100:00100000:1.0:1790736152.076118:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1790736152.076130:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606657c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+17:8487:x1877722816086144:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790736152.076660:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606657c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+17:8487:x1877722816086144:12345-0@lo:502:llog_process_th.0 Request processed in 532us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736152.076670:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1790736152.077057:0:8487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633e85880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:8487:1877722816086144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790736152.077629:0:8487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633e84000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:8487:1877722816086272:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790736152.077684:0:8487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736152.077725:0:8487:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162f219480 going to sleep for 11 seconds 00000100:00100000:1.0:1790736152.077783:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816086272 00000100:00100000:1.0:1790736152.077790:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816086272 00000100:00100000:1.0:1790736152.077913:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1790736152.077923:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606654c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+17:8487:x1877722816086272:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790736152.078483:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606654c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+17:8487:x1877722816086272:12345-0@lo:502:llog_process_th.0 Request processed in 559us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736152.078492:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1790736152.078581:0:8487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633e84000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:8487:1877722816086272:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1790736152.078609:0:8487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1790736152.078767:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1790736152.078790:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790736152.078802:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff941611931400/0x6aae200528fe6236 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe623d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736152.078893:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff941611931400/0x6aae200528fe6236 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe623d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790736152.078905:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1790736152.078909:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1790736152.078912:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790736152.078945:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c8200/0x6aae200528fe6244 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736152.078954:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff94162f8c8200/0x6aae200528fe6244 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736152.078964:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff94162f8c8200/0x6aae200528fe6244 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736152.079000:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f240a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816086400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790736152.079041:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736152.079086:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607c03480 going to sleep for 11 seconds 00000100:00100000:1.0:1790736152.079216:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816086400 00000100:00100000:1.0:1790736152.079232:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816086400 00000100:00100000:1.0:1790736152.079259:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1790736152.079266:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606657050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+17:5841:x1877722816086400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790736152.079278:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736152.079298:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94162156e600/0x6aae200528fe624b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe6244 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736152.079319:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94162156e600/0x6aae200528fe624b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe6244 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736152.079329:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94162156e600/0x6aae200528fe624b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe6244 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736152.079337:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162156e600, rc 0) 00000100:00100000:1.0:1790736152.079365:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606657050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+18:5841:x1877722816086400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736152.079385:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1790736152.079701:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f240a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816086400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790736152.079715:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff94162f8c8200/0x6aae200528fe6244 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe624b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736152.079722:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff94162f8c8200/0x6aae200528fe6244 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe624b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736152.079773:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f240a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816086528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790736152.079799:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736152.079911:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816086528 00000100:00100000:1.0:1790736152.079917:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816086528 00000100:00100000:3.0:1790736152.079986:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607c03480 going to sleep for 11 seconds 00000100:00100000:1.0:1790736152.080022:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1790736152.080030:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606657850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+18:5841:x1877722816086528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790736152.080411:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606657850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+18:5841:x1877722816086528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 380us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736152.080418:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1790736152.080811:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f240a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816086528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790736152.080924:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f240a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816086656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790736152.080964:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736152.081025:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607c03480 going to sleep for 11 seconds 00000100:00100000:2.0:1790736152.081059:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816086656 00000100:00100000:2.0:1790736152.081064:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816086656 00000100:00100000:2.0:1790736152.081617:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1790736152.081629:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+18:5841:x1877722816086656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790736152.081814:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+18:5841:x1877722816086656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 187us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736152.081831:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1790736152.081911:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f240a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816086656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790736152.082446:0:8488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fad4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:8488:1877722816086784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790736152.082489:0:8488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736152.082747:0:8488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416106f3300 going to sleep for 11 seconds 00000100:00100000:1.0:1790736152.082823:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816086784 00000100:00100000:1.0:1790736152.082830:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816086784 00000100:00100000:1.0:1790736152.082858:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1790736152.082866:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606654050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+18:8488:x1877722816086784:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790736152.083066:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606654050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+18:8488:x1877722816086784:12345-0@lo:502:llog_process_th.0 Request processed in 200us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736152.083074:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1790736152.083243:0:8488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fad4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:8488:1877722816086784:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790736152.083270:0:8488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790736152.083280:0:8488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790736152.083283:0:8488:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790736152.083289:0:8488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1790736152.083314:0:8488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fad4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:8488:1877722816086912:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790736152.083349:0:8488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736152.083389:0:8488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416106f3300 going to sleep for 11 seconds 00000100:00100000:1.0:1790736152.083571:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816086912 00000100:00100000:1.0:1790736152.083584:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816086912 00000100:00100000:1.0:1790736152.083606:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1790736152.083612:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606654450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+18:8488:x1877722816086912:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790736152.083769:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606654450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+18:8488:x1877722816086912:12345-0@lo:502:llog_process_th.0 Request processed in 155us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736152.083774:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1790736152.083856:0:8488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fad4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:8488:1877722816086912:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790736152.083873:0:8488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790736152.083878:0:8488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790736152.083879:0:8488:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790736152.083882:0:8488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1790736152.085416:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1790736152.085460:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1790736152.085472:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c8200/0x6aae200528fe6244 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe624b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736152.085484:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff94162f8c8200/0x6aae200528fe6244 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe624b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790736152.085496:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1790736152.085500:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff94160837b380 from 1 10000000:01000000:1.0:1790736152.085503:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790736152.085544:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162156fc00/0x6aae200528fe6252 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736152.085554:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff94162156fc00/0x6aae200528fe6252 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736152.085564:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff94162156fc00/0x6aae200528fe6252 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736152.085586:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816087040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790736152.085645:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736152.085677:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941635cc2240 going to sleep for 11 seconds 00000100:00100000:2.0:1790736152.085990:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816087040 00000100:00100000:2.0:1790736152.085997:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816087040 00000100:00100000:2.0:1790736152.086052:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1790736152.086062:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606655050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+18:5841:x1877722816087040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790736152.086075:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736152.086088:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941611931200/0x6aae200528fe6259 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe6252 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736152.086136:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941611931200/0x6aae200528fe6259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe6252 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736152.086147:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941611931200/0x6aae200528fe6259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe6252 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736152.086156:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611931200, rc 0) 00000100:00100000:2.0:1790736152.086206:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606655050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+19:5841:x1877722816087040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736152.086213:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1790736152.086524:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816087040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790736152.086540:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff94162156fc00/0x6aae200528fe6252 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6259 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736152.086549:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff94162156fc00/0x6aae200528fe6252 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe6259 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736152.086600:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816087168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790736152.086626:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736152.086647:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941635cc2240 going to sleep for 11 seconds 00000100:00100000:2.0:1790736152.086688:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816087168 00000100:00100000:2.0:1790736152.086693:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816087168 00000100:00100000:2.0:1790736152.086722:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1790736152.086728:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606655c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+19:5841:x1877722816087168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790736152.087056:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606655c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+19:5841:x1877722816087168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 327us (428us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790736152.087064:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1790736152.087166:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816087168:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1790736152.087190:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1790736152.087197:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162156fc00/0x6aae200528fe6252 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6259 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736152.087205:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff94162156fc00/0x6aae200528fe6252 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6259 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736152.213546:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f240a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816087296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790736152.213634:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736152.214181:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816087296 00000100:00100000:3.0:1790736152.214191:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816087296 00000100:00100000:3.0:1790736152.214577:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790736152.214589:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816087296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790736152.214628:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790736152.214705:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816087296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736152.214726:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1790736152.214809:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94162f240a80 x1877722816087296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736168 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736152.214830:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f240a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816087296:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790736152.341936:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736152.389839:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736152.389968:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797183616 00000100:00100000:0.0:1790736152.389978:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797183616 00000100:00100000:0.0:1790736152.390042:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 165 00000100:00100000:0.0:1790736152.390051:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606655850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+8:5596:x1877722797183616:12345-192.168.203.5@tcp:101: 00010000:00010000:0.0:1790736152.390067:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736152.390085:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941600031e00/0x6aae200528fe6260 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x92962417a526cd0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736152.390547:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941600031e00/0x6aae200528fe6260 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526cd0 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736152.390560:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941600031e00/0x6aae200528fe6260 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526cd0 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736152.390570:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941600031e00, rc 0) 00000100:00100000:0.0:1790736152.390635:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606655850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+9:5596:x1877722797183616:12345-192.168.203.5@tcp:101: Request processed in 585us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736152.390643:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 165 00000100:00100000:1.0:1790736152.400326:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736152.400483:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797183744 00000100:00100000:2.0:1790736152.400493:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797183744 00000100:00100000:2.0:1790736152.400548:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 166 00000100:00100000:2.0:1790736152.400558:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606654850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+9:5596:x1877722797183744:12345-192.168.203.5@tcp:501: 00000100:00100000:2.0:1790736152.400855:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606654850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+9:5596:x1877722797183744:12345-192.168.203.5@tcp:501: Request processed in 297us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736152.400864:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 166 00000100:00100000:3.0:1790736152.408613:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736152.408857:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797183872 00000100:00100000:0.0:1790736152.408868:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797183872 00000100:00100000:0.0:1790736152.408939:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 167 00000100:00100000:0.0:1790736152.408950:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606655450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+9:5596:x1877722797183872:12345-192.168.203.5@tcp:503: 00000100:00100000:0.0:1790736152.409234:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606655450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+9:5596:x1877722797183872:12345-192.168.203.5@tcp:503: Request processed in 285us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736152.409242:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 167 00000100:00100000:3.0:1790736152.417670:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736152.417816:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797184000 00000100:00100000:1.0:1790736152.417826:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797184000 00000100:00100000:1.0:1790736152.417881:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 168 00000100:00100000:1.0:1790736152.417904:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606656450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+9:6067:x1877722797184000:12345-192.168.203.5@tcp:502: 00000100:00100000:1.0:1790736152.419011:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606656450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+9:6067:x1877722797184000:12345-192.168.203.5@tcp:502: Request processed in 1098us (1341us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736152.419022:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 168 00000100:00100000:1.0:1790736152.434816:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736152.434938:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797184128 00000100:00100000:0.0:1790736152.434948:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797184128 00000100:00100000:0.0:1790736152.435062:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 169 00000100:00100000:0.0:1790736152.435073:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606657450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+9:6067:x1877722797184128:12345-192.168.203.5@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790736152.435596:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606657450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+9:6067:x1877722797184128:12345-192.168.203.5@tcp:502:llog_process_th.0 Request processed in 522us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736152.435604:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 169 00000100:00100000:3.0:1790736152.443754:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736152.444280:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797184256 00000100:00100000:1.0:1790736152.444291:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797184256 00000100:00100000:1.0:1790736152.444351:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 170 00000100:00100000:1.0:1790736152.444361:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606656c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+9:5596:x1877722797184256:12345-192.168.203.5@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790736152.444386:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736152.444407:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94162156ec00/0x6aae200528fe6267 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x92962417a526cd7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736152.444437:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94162156ec00/0x6aae200528fe6267 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526cd7 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736152.444449:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94162156ec00/0x6aae200528fe6267 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526cd7 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736152.444457:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162156ec00, rc 0) 00000100:00100000:1.0:1790736152.444528:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606656c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+10:5596:x1877722797184256:12345-192.168.203.5@tcp:101:ll_cfg_requeue.0 Request processed in 168us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736152.444535:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 170 00000100:00100000:3.0:1790736152.449320:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736152.449522:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797184384 00000100:00100000:0.0:1790736152.449564:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797184384 00000100:00100000:0.0:1790736152.449632:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 171 00000100:00100000:0.0:1790736152.449641:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94161094a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+10:5596:x1877722797184384:12345-192.168.203.5@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790736152.449938:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94161094a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+10:5596:x1877722797184384:12345-192.168.203.5@tcp:501:ll_cfg_requeue.0 Request processed in 296us (626us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790736152.449946:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 171 00010000:00010000:0.0:1790736153.365251:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790736153.549348:0:8525:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc655146a0 20000000:00000080:3.0:1790736153.549446:0:8525:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff94163fad1400 uarg=0000000000000000 20000000:01000000:3.0:1790736153.549486:0:8525:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1790736153.549492:0:8525:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1790736153.549496:0:8525:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1790736153.550580:0:8526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1790736153.550755:0:8525:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1790736153.555688:0:8525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1790736153.555749:0:8525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1790736153.555805:0:8525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1790736153.555822:0:8525:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790736153.555840:0:8525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94162f8c9400/0x6aae200528fe626e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736153.555858:0:8525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff941642173e00/0x6aae200528fe5fe3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe5fdc expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736153.555865:0:8525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff941611931000/0x6aae200528fe6045 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe603e expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736153.555872:0:8525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff941611930600/0x6aae200528fe6110 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe6109 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736153.555882:0:8525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff941611931800/0x6aae200528fe61cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526c9f expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736153.555903:0:8525:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94162f8c9400/0x6aae200528fe626e lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736153.555940:0:8525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff941611931800/0x6aae200528fe61cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0x92962417a526c9f expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736153.555955:0:8525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff941611931800/0x6aae200528fe61cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526c9f expref: 9 pid: 5838 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736153.555969:0:8525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f241f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8525:1877722816087424:192.168.203.5@tcp:104: 00010000:00010000:3.0:1790736153.556083:0:8525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff941611930600/0x6aae200528fe6110 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6aae200528fe6109 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736153.556124:0:8525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff941611930600/0x6aae200528fe6110 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6aae200528fe6109 expref: 18 pid: 5837 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736153.556135:0:8525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f241880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8525:1877722816087552:0@lo:104: 00000100:00100000:3.0:1790736153.556173:0:8525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790736153.556215:0:8525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff941611931000/0x6aae200528fe6045 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6aae200528fe603e expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736153.556236:0:8525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff941611931000/0x6aae200528fe6045 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6aae200528fe603e expref: 18 pid: 5836 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736153.556244:0:8525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f240a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8525:1877722816087680:0@lo:104: 00000100:00100000:3.0:1790736153.556267:0:8525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736153.556301:0:5826:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1790736153.556312:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816087552 00000100:00100000:3.0:1790736153.556324:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816087552 00000100:00100000:3.0:1790736153.556358:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816087680 00000100:00100000:3.0:1790736153.556371:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816087680 00000100:00100000:3.0:1790736153.556395:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790736153.556403:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f240000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:52e04a2b-4e01-44b7-985c-7db034e22389+4:8525:x1877722816087552:12345-0@lo:104: 00010000:00010000:3.0:1790736153.556415:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff94162156f600/0x6aae200528fe6109 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe6110 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736153.556460:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790736153.556466:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f240000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:52e04a2b-4e01-44b7-985c-7db034e22389+4:8525:x1877722816087552:12345-0@lo:104: Request processed in 64us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736153.556473:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790736153.556490:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790736153.556495:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f244c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:52e04a2b-4e01-44b7-985c-7db034e22389+3:8525:x1877722816087680:12345-0@lo:104: 00010000:00010000:3.0:1790736153.556502:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff941642173c00/0x6aae200528fe603e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe6045 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736153.556531:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790736153.556535:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f244c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:52e04a2b-4e01-44b7-985c-7db034e22389+3:8525:x1877722816087680:12345-0@lo:104: Request processed in 41us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736153.556541:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1790736153.556582:0:8525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff941642173e00/0x6aae200528fe5fe3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6aae200528fe5fdc expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736153.556590:0:8525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff941642173e00/0x6aae200528fe5fe3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6aae200528fe5fdc expref: 18 pid: 5836 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736153.556599:0:8525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f240000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8525:1877722816087808:0@lo:104: 00000100:00100000:3.0:1790736153.556620:0:8525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736153.556646:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816087808 00000100:00100000:3.0:1790736153.556650:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816087808 00000100:00100000:3.0:1790736153.556667:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790736153.556673:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f243100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:52e04a2b-4e01-44b7-985c-7db034e22389+3:8525:x1877722816087808:12345-0@lo:104: 00010000:00010000:3.0:1790736153.556680:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff941611930000/0x6aae200528fe5fdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe5fe3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736153.556707:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1790736153.556712:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f243100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:52e04a2b-4e01-44b7-985c-7db034e22389+3:8525:x1877722816087808:12345-0@lo:104: Request processed in 39us (91us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736153.556718:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790736153.556737:0:8525:0:(client.c:2716:ptlrpc_set_wait()) set ffff94161871a900 going to sleep for 11 seconds 00000100:00100000:3.0:1790736153.556758:0:8525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f241880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8525:1877722816087552:0@lo:104: 00000100:00100000:3.0:1790736153.556767:0:8525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f240a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8525:1877722816087680:0@lo:104: 00000100:00100000:3.0:1790736153.556773:0:8525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f240000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8525:1877722816087808:0@lo:104: 00010000:00010000:2.0:1790736153.557148:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790736153.557156:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff94162156f600/0x6aae200528fe6109 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe6110 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736153.557164:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162156f600 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:2.0:1790736153.557168:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff94162156f600/0x6aae200528fe6109 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6aae200528fe6110 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736153.557176:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff94162156f600/0x6aae200528fe6109 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6aae200528fe6110 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790736153.557196:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff94162156f600/0x6aae200528fe6109 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6aae200528fe6110 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790736153.557203:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790736153.557243:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff94162156f600/0x6aae200528fe6109 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe6110 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736153.557250:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790736153.557271:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff94162156f600/0x6aae200528fe6109 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe6110 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736153.557279:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff94162156f600/0x6aae200528fe6109 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe6110 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736153.557293:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790736153.557297:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff941642173c00/0x6aae200528fe603e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe6045 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736153.557304:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642173c00 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:2.0:1790736153.557308:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff941642173c00/0x6aae200528fe603e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6aae200528fe6045 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736153.557315:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff941642173c00/0x6aae200528fe603e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6aae200528fe6045 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790736153.557322:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff941642173c00/0x6aae200528fe603e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6aae200528fe6045 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790736153.557329:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790736153.557348:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff941642173c00/0x6aae200528fe603e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe6045 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736153.557354:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790736153.557360:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff941642173c00/0x6aae200528fe603e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe6045 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736153.557384:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff941642173c00/0x6aae200528fe603e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe6045 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736153.557394:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790736153.557397:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff941611930000/0x6aae200528fe5fdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe5fe3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736153.557403:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941611930000 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:2.0:1790736153.557406:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff941611930000/0x6aae200528fe5fdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6aae200528fe5fe3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736153.557413:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff941611930000/0x6aae200528fe5fdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6aae200528fe5fe3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790736153.557419:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff941611930000/0x6aae200528fe5fdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6aae200528fe5fe3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790736153.557424:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790736153.557436:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff941611930000/0x6aae200528fe5fdc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe5fe3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736153.557442:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790736153.557458:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff941611930000/0x6aae200528fe5fdc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe5fe3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736153.557474:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff941611930000/0x6aae200528fe5fdc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe5fe3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736153.557488:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736153.557490:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736153.557491:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790736153.557504:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633e84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816087936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790736153.557542:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736153.557565:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790736153.557571:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816088064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790736153.557592:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736153.557615:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633e87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816088192:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790736153.557636:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736153.557662:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816087936 00000100:00100000:2.0:1790736153.557667:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816087936 00010000:00010000:2.0:1790736153.557689:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff941611930600/0x6aae200528fe6110 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe6109 expref: 19 pid: 5837 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736153.557704:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816088064 00000100:00100000:2.0:1790736153.557706:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816088064 00010000:00010000:2.0:1790736153.557716:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff941611931000/0x6aae200528fe6045 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe603e expref: 20 pid: 5836 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736153.557725:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816088192 00000100:00100000:2.0:1790736153.557728:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816088192 00010000:00010000:2.0:1790736153.557736:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff941642173e00/0x6aae200528fe5fe3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe5fdc expref: 21 pid: 5836 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736153.557761:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790736153.557767:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52e04a2b-4e01-44b7-985c-7db034e22389+21:3306:x1877722816087936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790736153.557779:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790736153.557785:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff941611930600/0x6aae200528fe6110 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe6109 expref: 21 pid: 5837 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736153.557794:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff941611930600/0x6aae200528fe6110 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6aae200528fe6109 expref: 21 pid: 5837 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736153.557806:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941611930600/0x6aae200528fe6110 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6aae200528fe6109 expref: 21 pid: 5837 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736153.557817:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790736153.560885:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736153.560919:0:5828:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1790736153.560933:0:5828:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1790736153.561867:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52e04a2b-4e01-44b7-985c-7db034e22389+20:3306:x1877722816087936:12345-0@lo:103:ldlm_bl.0 Request processed in 4092us (4317us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736153.561882:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790736153.561919:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790736153.561932:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52e04a2b-4e01-44b7-985c-7db034e22389+19:3306:x1877722816088064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790736153.561952:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790736153.561961:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff941611931000/0x6aae200528fe6045 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe603e expref: 19 pid: 5836 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736153.561974:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff941611931000/0x6aae200528fe6045 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6aae200528fe603e expref: 19 pid: 5836 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736153.561991:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941611931000/0x6aae200528fe6045 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6aae200528fe603e expref: 19 pid: 5836 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736153.562019:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790736153.562067:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52e04a2b-4e01-44b7-985c-7db034e22389+18:3306:x1877722816088064:12345-0@lo:103:ldlm_bl.0 Request processed in 140us (4474us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736153.562073:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790736153.562084:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790736153.562110:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52e04a2b-4e01-44b7-985c-7db034e22389+17:3308:x1877722816088192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790736153.562119:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790736153.562123:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff941642173e00/0x6aae200528fe5fe3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe5fdc expref: 17 pid: 5836 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736153.562131:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff941642173e00/0x6aae200528fe5fe3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6aae200528fe5fdc expref: 17 pid: 5836 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736153.562140:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941642173e00/0x6aae200528fe5fe3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6aae200528fe5fdc expref: 17 pid: 5836 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736153.562149:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790736153.562178:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52e04a2b-4e01-44b7-985c-7db034e22389+16:3308:x1877722816088192:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (4541us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736153.562184:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790736153.562244:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633e87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816088192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790736153.562422:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816088064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790736153.562441:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633e84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816087936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790736153.563087:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736153.563746:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797184512 00000100:00100000:2.0:1790736153.563754:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797184512 00010000:00010000:2.0:1790736153.563787:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff941611931800/0x6aae200528fe61cd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526c9f expref: 10 pid: 5838 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736153.563825:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 24 00000100:00100000:2.0:1790736153.563844:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162edc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:637df299-95a2-42b2-90c0-64260eee1701+10:2355:x1877722797184512:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790736153.563860:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790736153.563865:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff941611931800/0x6aae200528fe61cd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526c9f expref: 10 pid: 5838 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736153.563877:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff941611931800/0x6aae200528fe61cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526c9f expref: 10 pid: 5838 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736153.563897:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94162f8c9400/0x6aae200528fe626e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736153.563906:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94162f8c9400/0x6aae200528fe626e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736153.563922:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94162f8c9400/0x6aae200528fe626e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736153.563930:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94162f8c9400/0x6aae200528fe626e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736153.563937:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94162f8c9400/0x6aae200528fe626e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736153.563944:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94162f8c9400/0x6aae200528fe626e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736153.563950:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c9400 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:2.0:1790736153.563954:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94162f8c9400/0x6aae200528fe626e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736153.563961:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94162f8c9400/0x6aae200528fe626e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736153.563977:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94162f8c9400/0x6aae200528fe626e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736153.563988:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790736153.564037:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162edc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:637df299-95a2-42b2-90c0-64260eee1701+10:2355:x1877722797184512:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 194us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736153.564045:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 24 00010000:00010000:3.0:1790736153.565297:0:8525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941611931800/0x6aae200528fe61cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526c9f expref: 9 pid: 5838 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736153.565314:0:8525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f241f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8525:1877722816087424:192.168.203.5@tcp:104: 00010000:00010000:3.0:1790736153.565484:0:8525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94162f8c9400/0x6aae200528fe626e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736153.565495:0:8525:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94162f8c9400/0x6aae200528fe626e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736153.565502:0:8525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94162f8c9400/0x6aae200528fe626e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736153.565509:0:8525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94162f8c9400/0x6aae200528fe626e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736153.946238:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736153.946356:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797184640 00000100:00100000:2.0:1790736153.946375:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797184640 00000100:00100000:2.0:1790736153.946431:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 172 00000100:00100000:2.0:1790736153.946441:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94161094bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+9:5596:x1877722797184640:12345-192.168.203.5@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790736153.946459:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736153.946480:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941611931000/0x6aae200528fe6275 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x92962417a526cde expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736153.946510:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941611931000/0x6aae200528fe6275 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526cde expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736153.946521:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941611931000/0x6aae200528fe6275 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526cde expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736153.946530:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611931000, rc 0) 00000100:00100000:2.0:1790736153.946599:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94161094bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+10:5596:x1877722797184640:12345-192.168.203.5@tcp:101:ll_cfg_requeue.0 Request processed in 159us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736153.946606:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 172 00000100:00100000:2.0:1790736153.952448:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736153.952541:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797184768 00000100:00100000:0.0:1790736153.952551:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797184768 00000100:00100000:0.0:1790736153.952604:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 173 00000100:00100000:0.0:1790736153.952613:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941610948c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+10:5596:x1877722797184768:12345-192.168.203.5@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790736153.952885:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941610948c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+10:5596:x1877722797184768:12345-192.168.203.5@tcp:501:ll_cfg_requeue.0 Request processed in 272us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736153.952893:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 173 00000100:00100000:3.0:1790736153.967512:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736153.967670:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797184896 00000100:00100000:1.0:1790736153.967681:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797184896 00000100:00100000:1.0:1790736153.967750:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 174 00000100:00100000:1.0:1790736153.967760:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94161094b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+10:5596:x1877722797184896:12345-192.168.203.5@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790736153.968018:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94161094b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+10:5596:x1877722797184896:12345-192.168.203.5@tcp:503:ll_cfg_requeue.0 Request processed in 258us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736153.968027:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 174 00000100:00100000:1.0:1790736153.983659:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736153.983779:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797185024 00000100:00100000:2.0:1790736153.983812:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797185024 00000100:00100000:2.0:1790736153.983886:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 175 00000100:00100000:2.0:1790736153.983896:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94161094b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+10:6120:x1877722797185024:12345-192.168.203.5@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790736153.984221:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94161094b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+10:6120:x1877722797185024:12345-192.168.203.5@tcp:502:llog_process_th.0 Request processed in 325us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736153.984229:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 175 00000100:00100000:2.0:1790736153.999608:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736153.999742:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797185152 00000100:00100000:0.0:1790736153.999751:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797185152 00000100:00100000:0.0:1790736153.999806:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 176 00000100:00100000:0.0:1790736153.999815:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94161094a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+10:6120:x1877722797185152:12345-192.168.203.5@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790736154.000055:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94161094a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+10:6120:x1877722797185152:12345-192.168.203.5@tcp:502:llog_process_th.0 Request processed in 239us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736154.000063:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 176 00010000:00010000:2.0:1790736154.408523:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736155.415882:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790736155.491569:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790736155.491579:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94162d364800 from 4 10000000:01000000:0.0:1790736155.491583:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790736155.491629:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe627c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736155.491650:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe627c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736155.491662:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe627c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736155.491687:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fad5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816088320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790736155.491758:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736155.491815:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416063fdc00 going to sleep for 11 seconds 00000100:00100000:1.0:1790736155.496934:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816088320 00000100:00100000:1.0:1790736155.496951:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816088320 00000100:00100000:1.0:1790736155.497000:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1790736155.497009:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941610948050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+16:5841:x1877722816088320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790736155.497027:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736155.497047:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94162156e400/0x6aae200528fe6283 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe627c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736155.497077:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94162156e400/0x6aae200528fe6283 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe627c expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736155.497087:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94162156e400/0x6aae200528fe6283 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe627c expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736155.497111:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162156e400, rc 0) 00000100:00100000:1.0:1790736155.497195:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941610948050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+17:5841:x1877722816088320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (5437us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736155.497202:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1790736155.497230:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fad5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816088320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790736155.497247:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe627c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6283 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736155.497256:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe627c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe6283 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736155.497324:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fad5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816088448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790736155.497369:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736155.497411:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416063fdc00 going to sleep for 11 seconds 00000100:00100000:1.0:1790736155.497954:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816088448 00000100:00100000:1.0:1790736155.497961:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816088448 00000100:00100000:1.0:1790736155.497991:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1790736155.497997:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941610948450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+17:5841:x1877722816088448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790736155.498403:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941610948450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+17:5841:x1877722816088448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 404us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736155.498411:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1790736155.498450:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fad5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816088448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790736155.498503:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163ad19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816088576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790736155.498543:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736155.498569:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607efb300 going to sleep for 11 seconds 00000100:00100000:1.0:1790736155.498581:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816088576 00000100:00100000:1.0:1790736155.498585:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816088576 00000100:00100000:1.0:1790736155.498608:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1790736155.498613:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941610949050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+17:5841:x1877722816088576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790736155.498762:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941610949050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+17:5841:x1877722816088576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736155.498769:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1790736155.498805:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163ad19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816088576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790736155.498976:0:8609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163ad19880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:8609:1877722816088704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790736155.499009:0:8609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736155.499027:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816088704 00000100:00100000:1.0:1790736155.499036:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816088704 00000100:00100000:1.0:1790736155.499057:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1790736155.499063:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941610949c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+17:8609:x1877722816088704:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790736155.499209:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941610949c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+17:8609:x1877722816088704:12345-0@lo:502:llog_process_th.0 Request processed in 145us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736155.499215:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1790736155.499245:0:8609:0:(client.c:2716:ptlrpc_set_wait()) set ffff941633c42000 going to sleep for 11 seconds 00000100:00100000:1.0:1790736155.499256:0:8609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163ad19880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:8609:1877722816088704:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790736155.499276:0:8609:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790736155.499285:0:8609:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790736155.499287:0:8609:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790736155.499293:0:8609:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94162d364800 00000020:00000080:1.0:1790736155.499295:0:8609:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790736155.499373:0:8609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163ad19880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:8609:1877722816088832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790736155.499403:0:8609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736155.499419:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816088832 00000100:00100000:1.0:1790736155.499422:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816088832 00000100:00100000:1.0:1790736155.499441:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1790736155.499446:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941610949850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+17:8609:x1877722816088832:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790736155.499542:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941610949850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+17:8609:x1877722816088832:12345-0@lo:502:llog_process_th.0 Request processed in 95us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736155.499549:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1790736155.499577:0:8609:0:(client.c:2716:ptlrpc_set_wait()) set ffff941633c42000 going to sleep for 11 seconds 00000100:00100000:1.0:1790736155.499588:0:8609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163ad19880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:8609:1877722816088832:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790736155.499604:0:8609:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790736155.499608:0:8609:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790736155.499614:0:8609:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1790736155.499618:0:8609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1790736155.499668:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1790736155.499685:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790736155.499695:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe627c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6283 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736155.499707:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe627c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6283 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790736155.499716:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790736155.499719:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94162d353800 from 4 10000000:01000000:1.0:1790736155.499721:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790736155.499743:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162156f200/0x6aae200528fe628a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736155.499750:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff94162156f200/0x6aae200528fe628a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736155.499758:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff94162156f200/0x6aae200528fe628a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736155.499771:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163ad19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816088960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790736155.499797:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736155.499810:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941633c42000 going to sleep for 11 seconds 00000100:00100000:1.0:1790736155.499820:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816088960 00000100:00100000:1.0:1790736155.499824:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816088960 00000100:00100000:1.0:1790736155.499844:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1790736155.499850:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941610948850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+17:5841:x1877722816088960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790736155.499858:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736155.499876:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94162156e000/0x6aae200528fe6291 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe628a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736155.499896:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94162156e000/0x6aae200528fe6291 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe628a expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736155.499904:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94162156e000/0x6aae200528fe6291 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe628a expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736155.499914:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162156e000, rc 0) 00000100:00100000:1.0:1790736155.499940:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941610948850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+18:5841:x1877722816088960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736155.499946:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1790736155.499974:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163ad19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816088960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790736155.499985:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff94162156f200/0x6aae200528fe628a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6291 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736155.499993:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff94162156f200/0x6aae200528fe628a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe6291 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736155.500031:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163ad19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816089088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790736155.500056:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736155.500068:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941633c42000 going to sleep for 11 seconds 00000100:00100000:1.0:1790736155.500078:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816089088 00000100:00100000:1.0:1790736155.500081:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816089088 00000100:00100000:1.0:1790736155.500122:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1790736155.500129:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941610949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+18:5841:x1877722816089088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790736155.500306:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941610949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+18:5841:x1877722816089088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 178us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736155.500318:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1790736155.500363:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163ad19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816089088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790736155.500386:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163ad19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816089216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790736155.500420:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736155.500434:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941633c42000 going to sleep for 11 seconds 00000100:00100000:1.0:1790736155.500445:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816089216 00000100:00100000:1.0:1790736155.500448:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816089216 00000100:00100000:1.0:1790736155.500467:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1790736155.500472:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94161094a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+18:5841:x1877722816089216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790736155.500576:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94161094a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+18:5841:x1877722816089216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736155.500582:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1790736155.500616:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163ad19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816089216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790736155.500860:0:8610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163ad19880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:8610:1877722816089344:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790736155.500893:0:8610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736155.500911:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816089344 00000100:00100000:1.0:1790736155.500915:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816089344 00000100:00100000:1.0:1790736155.500935:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1790736155.500941:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94161094b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+18:8610:x1877722816089344:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790736155.501050:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94161094b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+18:8610:x1877722816089344:12345-0@lo:502:llog_process_th.0 Request processed in 108us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736155.501056:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1790736155.501082:0:8610:0:(client.c:2716:ptlrpc_set_wait()) set ffff941633c42a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790736155.501117:0:8610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163ad19880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:8610:1877722816089344:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790736155.501142:0:8610:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790736155.501151:0:8610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790736155.501152:0:8610:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790736155.501158:0:8610:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94162d353800 00000020:00000080:1.0:1790736155.501160:0:8610:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790736155.501214:0:8610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163ad19880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:8610:1877722816089472:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790736155.501246:0:8610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736155.501265:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816089472 00000100:00100000:1.0:1790736155.501269:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816089472 00000100:00100000:1.0:1790736155.501289:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1790736155.501296:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94161094ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+18:8610:x1877722816089472:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790736155.507998:0:8610:0:(client.c:2716:ptlrpc_set_wait()) set ffff941633c42a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790736155.515942:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94161094ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+18:8610:x1877722816089472:12345-0@lo:502:llog_process_th.0 Request processed in 14634us (14682us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736155.515956:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1790736155.516013:0:8610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163ad19880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:8610:1877722816089472:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790736155.516047:0:8610:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790736155.516055:0:8610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790736155.516058:0:8610:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1790736155.516062:0:8610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1790736155.516168:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1790736155.516184:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790736155.516195:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162156f200/0x6aae200528fe628a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6291 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736155.519113:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff94162156f200/0x6aae200528fe628a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6291 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790736155.519137:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790736155.519158:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff941604c0d800 from 4 10000000:01000000:1.0:1790736155.519161:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790736155.520621:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162156f800/0x6aae200528fe6298 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736155.520637:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff94162156f800/0x6aae200528fe6298 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736155.520649:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff94162156f800/0x6aae200528fe6298 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736155.520676:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163ad19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816089600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790736155.520744:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736155.520790:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941633c42a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790736155.520814:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816089600 00000100:00100000:1.0:1790736155.520821:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816089600 00000100:00100000:1.0:1790736155.520864:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1790736155.520872:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416055c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+18:5841:x1877722816089600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790736155.520885:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736155.520899:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94162156f600/0x6aae200528fe629f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe6298 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736155.520920:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94162156f600/0x6aae200528fe629f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe6298 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736155.520930:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94162156f600/0x6aae200528fe629f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe6298 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736155.520937:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162156f600, rc 0) 00000100:00100000:1.0:1790736155.520972:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416055c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+19:5841:x1877722816089600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736155.520987:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1790736155.521042:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163ad19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816089600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790736155.521056:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff94162156f800/0x6aae200528fe6298 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe629f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736155.521065:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff94162156f800/0x6aae200528fe6298 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe629f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736155.521136:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163ad19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816089728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790736155.521160:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736155.521171:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941633c42a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790736155.521181:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816089728 00000100:00100000:1.0:1790736155.521183:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816089728 00000100:00100000:1.0:1790736155.521200:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1790736155.523468:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416055c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+19:5841:x1877722816089728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790736155.525346:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416055c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+19:5841:x1877722816089728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4131us (4176us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736155.525372:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1790736155.525472:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163ad19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816089728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790736155.525528:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163ad19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816089856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790736155.526725:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736155.526780:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941633c42a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790736155.526805:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816089856 00000100:00100000:1.0:1790736155.526813:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816089856 00000100:00100000:1.0:1790736155.526854:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1790736155.526868:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416055c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+19:5841:x1877722816089856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790736155.527086:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416055c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+19:5841:x1877722816089856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 218us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736155.527114:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1790736155.527168:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163ad19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816089856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790736155.531183:0:8614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163ad19880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:8614:1877722816089984:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790736155.531261:0:8614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736155.531294:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816089984 00000100:00100000:1.0:1790736155.531300:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816089984 00000100:00100000:1.0:1790736155.531335:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1790736155.531343:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416055c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+19:8614:x1877722816089984:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790736155.531801:0:8614:0:(client.c:2716:ptlrpc_set_wait()) set ffff941633c42780 going to sleep for 11 seconds 00000100:00100000:1.0:1790736155.537258:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416055c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+19:8614:x1877722816089984:12345-0@lo:502:llog_process_th.0 Request processed in 5910us (5993us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736155.537271:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1790736155.537323:0:8614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163ad19880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:8614:1877722816089984:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790736155.537369:0:8614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790736155.537380:0:8614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790736155.537451:0:8614:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790736155.537463:0:8614:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff941604c0d800 00000020:00000080:3.0:1790736155.537465:0:8614:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790736155.537562:0:8614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f241f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:8614:1877722816090112:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790736155.537608:0:8614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736155.537646:0:8614:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416039e50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790736155.537664:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816090112 00000100:00100000:3.0:1790736155.537670:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816090112 00000100:00100000:3.0:1790736155.537713:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1790736155.537722:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416055ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+19:8614:x1877722816090112:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790736155.537847:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416055ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+19:8614:x1877722816090112:12345-0@lo:502:llog_process_th.0 Request processed in 126us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736155.537854:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1790736155.537890:0:8614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f241f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:8614:1877722816090112:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790736155.537908:0:8614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790736155.537912:0:8614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790736155.537914:0:8614:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1790736155.537917:0:8614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1790736155.544057:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1790736155.544104:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790736155.544118:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162156f800/0x6aae200528fe6298 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe629f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736155.544131:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff94162156f800/0x6aae200528fe6298 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe629f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736155.653276:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736155.653325:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736155.653468:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797185280 00000100:00100000:2.0:1790736155.653478:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797185280 00000100:00100000:2.0:1790736155.653535:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 192 00000100:00100000:2.0:1790736155.653555:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+10:2353:x1877722797185280:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1790736155.653624:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+10:2353:x1877722797185280:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 70us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736155.653632:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 192 00000100:00100000:3.0:1790736155.655876:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736155.655915:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797185664 00000100:00100000:2.0:1790736155.655925:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797185664 00000100:00100000:3.0:1790736155.655932:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736155.655986:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797185536 00000100:00100000:2.0:1790736155.655990:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797185536 00000100:00100000:2.0:1790736155.656007:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 17 00000100:00100000:2.0:1790736155.656015:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2354:x1877722797185664:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736155.656063:0:6698:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1790736155.656071:0:6698:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1790736155.656080:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2354:x1877722797185664:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 66us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736155.656087:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 17 00000100:00100000:2.0:1790736155.656119:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18 00000100:00100000:2.0:1790736155.656127:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2354:x1877722797185536:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1790736155.656159:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2354:x1877722797185536:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 33us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736155.656165:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18 00000100:00100000:0.0:1790736155.657645:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797185408 00000100:00100000:0.0:1790736155.657657:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797185408 00000100:00100000:0.0:1790736155.657716:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 33 00000100:00100000:0.0:1790736155.657724:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ad18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2353:x1877722797185408:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1790736155.657792:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ad18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2353:x1877722797185408:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 66us (4462us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736155.657815:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 33 00000100:00080000:0.0:1790736155.657846:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790736155.657852:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790736155.657856:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790736155.799495:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816090240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790736155.799562:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736155.799634:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816090240 00000100:00100000:0.0:1790736155.799642:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816090240 00000100:00100000:0.0:1790736155.799705:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790736155.799714:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816090240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790736155.799746:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790736155.799788:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816090240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736155.799795:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1790736155.799814:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790736155.799837:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163fad5500 x1877722816090240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736171 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790736155.799854:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816090240:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790736156.437405:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790736156.821490:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816090752:0@lo:400:kworker.0 00000100:00100000:0.0:1790736156.821603:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736156.821806:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877722816090496:0@lo:400:kworker.0 00000100:00100000:2.0:1790736156.821858:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736156.821994:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816091008:0@lo:400:kworker.0 00000100:00100000:0.0:1790736156.822269:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790736156.822279:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1877722816090624:0@lo:400:kworker.0 00000100:00100000:0.0:1790736156.822312:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736156.822362:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816090752 00000100:00100000:0.0:1790736156.822372:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816090752 00000100:00100000:0.0:1790736156.822433:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790736156.822461:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816090752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736156.822531:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816090752:12345-0@lo:400:kworker.0 Request processed in 72us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736156.822538:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790736156.822568:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816090496 00000100:00100000:0.0:1790736156.822572:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816090496 00000100:00100000:0.0:1790736156.822596:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816090624 00000100:00100000:0.0:1790736156.822599:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816090624 00000100:00100000:0.0:1790736156.822626:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790736156.822632:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877722816090496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736156.822663:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877722816090496:12345-0@lo:400:kworker.0 Request processed in 32us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736156.822669:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790736156.822681:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790736156.822687:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877722816090624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736156.822713:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877722816090624:12345-0@lo:400:kworker.0 Request processed in 28us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736156.822719:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1790736156.822744:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790736156.822762:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736156.822938:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816090368:0@lo:400:kworker.0 00000100:00100000:1.0:1790736156.822995:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736156.823032:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1877722816090880:0@lo:400:kworker.0 00000100:00100000:1.0:1790736156.823057:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736156.823471:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816090880 00000100:00100000:3.0:1790736156.823479:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816090880 00000100:00100000:3.0:1790736156.823536:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790736156.823545:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ad1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877722816090880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736156.823606:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ad1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877722816090880:12345-0@lo:400:kworker.0 Request processed in 63us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736156.823613:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790736156.823635:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816091008 00000100:00100000:3.0:1790736156.823638:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816091008 00000100:00100000:3.0:1790736156.823664:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790736156.823670:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816091008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736156.823704:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816091008:12345-0@lo:400:kworker.0 Request processed in 34us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736156.823711:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790736156.823730:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816090368 00000100:00100000:3.0:1790736156.823734:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816090368 00000100:00100000:3.0:1790736156.823761:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1790736156.823767:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+19:3306:x1877722816090368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736156.823799:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+19:3306:x1877722816090368:12345-0@lo:400:kworker.0 Request processed in 32us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736156.823805:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00080000:1.0:1790736156.823916:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790736156.823920:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790736156.824309:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816090368:0@lo:400:kworker.0 00000100:00100000:3.0:1790736156.824324:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1877722816090880:0@lo:400:kworker.0 00000100:00100000:0.0:1790736156.824535:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877722816090496:0@lo:400:kworker.0 00010000:00080000:0.0:1790736156.824563:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163fad7100 x1877722816091008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790736156.824575:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816091008:0@lo:400:kworker.0 00000100:00100000:0.0:1790736156.824629:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1877722816090624:0@lo:400:kworker.0 00010000:00080000:0.0:1790736156.824658:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163fad6d80 x1877722816090752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790736156.824668:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816090752:0@lo:400:kworker.0 00000100:00100000:1.0:1790736157.335210:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790736157.335240:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633e87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816091136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790736157.335345:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736157.335909:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816091136 00000100:00100000:2.0:1790736157.335921:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816091136 00000100:00100000:2.0:1790736157.335987:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790736157.335998:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ad1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816091136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790736157.336045:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790736157.336203:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ad1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816091136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 207us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736157.336212:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1790736157.336264:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff941633e87800 x1877722816091136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736173 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790736157.336287:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633e87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816091136:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790736157.462887:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736158.490782:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736159.510338:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790736160.267970:0:8827:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg305-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1790736160.533575:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790736160.783413:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736160.783474:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736160.783515:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736160.783660:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797185792 00000100:00100000:3.0:1790736160.783675:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797185792 00000100:00100000:3.0:1790736160.783754:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 194 00000100:00100000:3.0:1790736160.783767:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+10:2353:x1877722797185792:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736160.783872:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+10:2353:x1877722797185792:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 107us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736160.783881:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 194 00000100:00100000:0.0:1790736160.784173:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736160.784277:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797186176 00000100:00100000:0.0:1790736160.784282:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797186176 00000100:00100000:0.0:1790736160.784337:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797186048 00000100:00100000:0.0:1790736160.784341:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797186048 00000100:00100000:0.0:1790736160.784363:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 21 00000100:00100000:0.0:1790736160.784370:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2354:x1877722797186176:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1790736160.784412:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2354:x1877722797186176:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 42us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736160.784419:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 21 00000100:00100000:0.0:1790736160.784433:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 22 00000100:00100000:0.0:1790736160.784439:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2353:x1877722797186048:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1790736160.784465:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2353:x1877722797186048:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 26us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736160.784472:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 22 00000100:00080000:0.0:1790736160.784490:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790736160.784494:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790736160.784647:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797185920 00000100:00100000:2.0:1790736160.784653:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797185920 00000100:00100000:2.0:1790736160.784697:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 37 00000100:00100000:2.0:1790736160.784706:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2354:x1877722797185920:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1790736160.784755:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2354:x1877722797185920:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 50us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736160.784772:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 37 00000100:00080000:0.0:1790736160.785417:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790736160.918222:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790736160.918247:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f240a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816091264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790736160.918336:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736160.918421:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816091264 00000100:00100000:3.0:1790736160.918430:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816091264 00000100:00100000:3.0:1790736160.918499:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790736160.918509:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816091264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790736160.918562:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790736160.918631:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816091264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736160.918639:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1790736160.918665:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790736160.918697:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94162f240a80 x1877722816091264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736160.918718:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f240a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816091264:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790736161.559531:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736161.943126:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163ad19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877722816091520:0@lo:400:kworker.0 00000100:00100000:1.0:1790736161.943193:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736161.943313:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163ad18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816091392:0@lo:400:kworker.0 00000100:00100000:2.0:1790736161.943362:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736161.943417:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163ad1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1877722816091904:0@lo:400:kworker.0 00000100:00100000:2.0:1790736161.943450:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816091392 00000100:00100000:2.0:1790736161.943458:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816091392 00000100:00100000:2.0:1790736161.943505:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1790736161.943513:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+19:3306:x1877722816091392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736161.943561:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+19:3306:x1877722816091392:12345-0@lo:400:kworker.0 Request processed in 49us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736161.943568:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1790736161.943736:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163ad1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816092032:0@lo:400:kworker.0 00000100:00100000:1.0:1790736161.943761:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736161.943930:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163ad19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1877722816091648:0@lo:400:kworker.0 00000100:00100000:1.0:1790736161.943957:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736161.943978:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790736161.943983:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163ad18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816091776:0@lo:400:kworker.0 00000100:00100000:1.0:1790736161.944005:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736161.944038:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816092032 00000100:00100000:1.0:1790736161.944043:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816092032 00000100:00100000:1.0:1790736161.944084:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816091776 00000100:00100000:1.0:1790736161.944087:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816091776 00000100:00100000:1.0:1790736161.944147:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790736161.944154:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ad19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816092032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736161.944194:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ad19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816092032:12345-0@lo:400:kworker.0 Request processed in 40us (431us total) trans 0 rc 0/0 00000100:00080000:0.0:1790736161.944992:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790736161.945011:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790736161.945025:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ad18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816091776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736161.945085:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ad18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816091776:12345-0@lo:400:kworker.0 Request processed in 67us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736161.945105:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790736161.945130:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816091520 00000100:00100000:0.0:1790736161.945136:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816091520 00000100:00100000:0.0:1790736161.945162:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816091648 00000100:00100000:0.0:1790736161.945165:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816091648 00000100:00100000:0.0:1790736161.945187:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790736161.945193:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ad1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877722816091520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736161.945290:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790736161.945427:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790736161.945436:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ad1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877722816091648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736161.945478:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ad1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877722816091648:12345-0@lo:400:kworker.0 Request processed in 44us (1520us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736161.945484:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1790736161.945931:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163ad18380 x1877722816091776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736161.945947:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163ad18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816091776:0@lo:400:kworker.0 00000100:00100000:1.0:1790736161.945960:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163ad19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1877722816091648:0@lo:400:kworker.0 00010000:00080000:1.0:1790736161.945997:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163ad1b800 x1877722816092032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736161.946006:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163ad1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816092032:0@lo:400:kworker.0 00000100:00100000:1.0:1790736161.946037:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736161.946086:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163ad18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816091392:0@lo:400:kworker.0 00000100:00100000:0.0:1790736161.947035:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ad1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877722816091520:12345-0@lo:400:kworker.0 Request processed in 1839us (3837us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736161.947045:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790736161.947065:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816091904 00000100:00100000:0.0:1790736161.947070:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816091904 00000100:00100000:0.0:1790736161.947115:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790736161.947122:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ad1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877722816091904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736161.947158:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ad1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877722816091904:12345-0@lo:400:kworker.0 Request processed in 36us (1120us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736161.947164:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1790736161.947183:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790736161.947434:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163ad1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1877722816091904:0@lo:400:kworker.0 00000100:00100000:0.0:1790736161.948662:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163ad19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877722816091520:0@lo:400:kworker.0 00000100:00100000:3.0:1790736162.456895:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790736162.456918:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f240a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816092160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790736162.456988:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736162.457054:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816092160 00000100:00100000:3.0:1790736162.457062:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816092160 00000100:00100000:3.0:1790736162.457127:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790736162.457137:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816092160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790736162.457187:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790736162.457249:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816092160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736162.457256:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1790736162.457308:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94162f240a80 x1877722816092160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736178 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736162.457326:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f240a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816092160:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790736162.581609:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736163.610335:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736164.634215:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790736165.555027:0:9071:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg305-server.virtnet: executing yml_node 00010000:00010000:1.0:1790736165.654510:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736165.896329:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736165.896363:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736165.896392:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797186304 00000100:00100000:3.0:1790736165.896401:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797186304 00000100:00100000:3.0:1790736165.896448:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 196 00000100:00100000:3.0:1790736165.896457:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+10:2353:x1877722797186304:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736165.896527:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+10:2353:x1877722797186304:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 70us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736165.896534:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 196 00000100:00100000:2.0:1790736165.896891:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797186432 00000100:00100000:2.0:1790736165.896897:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797186432 00000100:00100000:2.0:1790736165.896942:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 41 00000100:00100000:2.0:1790736165.896949:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f240a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2353:x1877722797186432:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1790736165.896982:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f240a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2353:x1877722797186432:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 35us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736165.896989:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 41 00000100:00080000:0.0:1790736165.897074:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790736165.908079:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736165.908163:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736165.908357:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797186560 00000100:00100000:1.0:1790736165.908370:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797186560 00000100:00100000:1.0:1790736165.908430:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797186688 00000100:00100000:1.0:1790736165.908434:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797186688 00000100:00100000:1.0:1790736165.908458:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 10 00000100:00100000:1.0:1790736165.908467:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2352:x1877722797186560:12345-192.168.203.5@tcp:9:kworker.0 00000020:00000080:1.0:1790736165.908502:0:6698:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6aae200528fe61db 00000100:00080000:1.0:1790736165.908512:0:6698:0:(import.c:65:import_set_state_nolock()) ffff941603186800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790736165.908550:0:6698:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1790736165.908881:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+2:2352:x1877722797186560:12345-192.168.203.5@tcp:9:kworker.0 Request processed in 414us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736165.908890:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 10 00000100:00100000:1.0:1790736165.908907:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 11 00000100:00100000:1.0:1790736165.908914:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2352:x1877722797186688:12345-192.168.203.5@tcp:9:kworker.0 00000020:00000080:1.0:1790736165.908936:0:6698:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6aae200528fe61e2 00000100:00080000:1.0:1790736165.908942:0:6698:0:(import.c:65:import_set_state_nolock()) ffff941603185800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790736165.908963:0:6698:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1790736165.909422:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+2:2352:x1877722797186688:12345-192.168.203.5@tcp:9:kworker.0 Request processed in 506us (1256us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736165.909429:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 11 00010000:00010000:1.0:1790736165.909457:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736165.909463:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790736165.910019:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790736165.910024:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790736166.037908:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790736166.037929:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163ad1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816092288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790736166.037994:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736166.038056:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816092288 00000100:00100000:1.0:1790736166.038063:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816092288 00000100:00100000:1.0:1790736166.038136:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790736166.038146:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ad18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816092288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790736166.038177:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790736166.038234:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ad18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816092288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736166.038241:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1790736166.038260:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790736166.038299:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163ad1aa00 x1877722816092288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736166.038318:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163ad1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816092288:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790736166.693996:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790736167.061544:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816092800:0@lo:400:kworker.0 00000100:00100000:0.0:1790736167.061612:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736167.061680:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790736167.061685:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1877722816092672:0@lo:400:kworker.0 00000100:00100000:0.0:1790736167.061711:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736167.061742:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816092800 00000100:00100000:0.0:1790736167.061750:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816092800 00000100:00100000:0.0:1790736167.061801:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790736167.061809:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816092800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736167.061862:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816092800:12345-0@lo:400:kworker.0 Request processed in 54us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736167.061870:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790736167.061892:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816092672 00000100:00100000:0.0:1790736167.061895:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816092672 00000100:00100000:0.0:1790736167.061927:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790736167.061933:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877722816092672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736167.061962:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877722816092672:12345-0@lo:400:kworker.0 Request processed in 28us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736167.061967:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1790736167.061984:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790736167.062018:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1877722816092672:0@lo:400:kworker.0 00010000:00080000:0.0:1790736167.062030:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163fad5c00 x1877722816092800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790736167.062040:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816092800:0@lo:400:kworker.0 00000100:00100000:2.0:1790736167.062388:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877722816092544:0@lo:400:kworker.0 00000100:00100000:2.0:1790736167.062420:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736167.062441:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816093056:0@lo:400:kworker.0 00000100:00100000:2.0:1790736167.062462:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736167.062489:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790736167.062506:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52e04a2b-4e01-44b7-985c-7db034e22389:3307:1877722816092416:0@lo:400:kworker.0 00000100:00100000:2.0:1790736167.062533:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736167.062556:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1877722816092928:0@lo:400:kworker.0 00000100:00100000:2.0:1790736167.062575:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736167.062600:0:8632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816093056 00000100:00100000:2.0:1790736167.062604:0:8632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816093056 00000100:00100000:2.0:1790736167.062637:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790736167.062643:0:8632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816093056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736167.062678:0:8632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816093056:12345-0@lo:400:kworker.0 Request processed in 35us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736167.062684:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790736167.062702:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816092416 00000100:00100000:2.0:1790736167.062705:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816092416 00000100:00100000:2.0:1790736167.062728:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1790736167.062734:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+19:3307:x1877722816092416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736167.062761:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+19:3307:x1877722816092416:12345-0@lo:400:kworker.0 Request processed in 27us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736167.062767:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1790736167.062798:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816092544 00000100:00100000:2.0:1790736167.062802:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816092544 00000100:00100000:2.0:1790736167.062820:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816092928 00000100:00100000:2.0:1790736167.062822:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816092928 00000100:00100000:2.0:1790736167.062840:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790736167.062846:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877722816092544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736167.062874:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877722816092544:12345-0@lo:400:kworker.0 Request processed in 28us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736167.062880:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790736167.062891:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790736167.062896:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877722816092928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736167.062917:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877722816092928:12345-0@lo:400:kworker.0 Request processed in 22us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736167.062923:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1790736167.062943:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790736167.062946:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790736167.062964:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52e04a2b-4e01-44b7-985c-7db034e22389:3307:1877722816092416:0@lo:400:kworker.0 00000100:00100000:2.0:1790736167.062973:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1877722816092928:0@lo:400:kworker.0 00000100:00100000:2.0:1790736167.062982:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877722816092544:0@lo:400:kworker.0 00010000:00080000:2.0:1790736167.062991:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163fad5180 x1877722816093056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790736167.063000:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816093056:0@lo:400:kworker.0 00000100:00100000:0.0:1790736167.573324:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790736167.573454:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816093184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790736167.576389:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736167.576605:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816093184 00000100:00100000:1.0:1790736167.576614:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816093184 00000100:00100000:1.0:1790736167.576687:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790736167.576695:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816093184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790736167.576740:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790736167.576803:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816093184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736167.576810:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1790736167.577007:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94162f243800 x1877722816093184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736183 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790736167.577028:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816093184:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790736167.702005:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736168.725470:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790736169.600067:0:9262:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.59.3 00000001:00100000:2.0:1790736169.743723:0:6725:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f945944d-9086-46a2-a91c-8bc7b88e8918 00000020:00000080:2.0:1790736169.743747:0:6725:0:(genops.c:885:class_export_put()) final put ffff941603183800/f945944d-9086-46a2-a91c-8bc7b88e8918 00000020:00000080:2.0:1790736169.743783:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff941603183800/f945944d-9086-46a2-a91c-8bc7b88e8918 for lustre-OST0000 00000020:00000080:2.0:1790736169.743839:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff941603186800 for lustre-OST0000 00010000:00010000:1.0:1790736169.752653:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790736170.763934:0:7658:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f945944d-9086-46a2-a91c-8bc7b88e8918 00000020:00000080:3.0:1790736170.763942:0:7658:0:(genops.c:885:class_export_put()) final put ffff941603181800/f945944d-9086-46a2-a91c-8bc7b88e8918 00000020:00000080:0.0:1790736170.764033:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff941603181800/f945944d-9086-46a2-a91c-8bc7b88e8918 for lustre-OST0001 00000020:00000080:0.0:1790736170.764083:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff941603185800 for lustre-OST0001 00010000:00010000:0.0:1790736170.774562:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790736171.010757:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736171.010803:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736171.010887:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797186944 00000100:00100000:3.0:1790736171.010897:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797186944 00000100:00100000:3.0:1790736171.010988:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 45 00000100:00100000:3.0:1790736171.010999:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2353:x1877722797186944:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736171.011082:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2353:x1877722797186944:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 85us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736171.011089:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 45 00000100:00080000:0.0:1790736171.011391:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790736171.011525:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797186816 00000100:00100000:2.0:1790736171.011531:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797186816 00000100:00100000:2.0:1790736171.011571:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 198 00000100:00100000:2.0:1790736171.011578:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+10:2353:x1877722797186816:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1790736171.011619:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+10:2353:x1877722797186816:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 41us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736171.011626:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 198 00000100:00100000:0.0:1790736171.159727:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163ad1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816093312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790736171.159806:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736171.163709:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816093312 00000100:00100000:1.0:1790736171.163725:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816093312 00000100:00100000:1.0:1790736171.163816:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790736171.163826:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816093312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790736171.163868:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790736171.163971:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816093312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (4164us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736171.163979:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1790736171.164082:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163ad1aa00 x1877722816093312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790736171.164142:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163ad1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816093312:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790736171.164304:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790736171.799274:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790736172.064357:0:9362:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.59.3 00000100:00100000:0.0:1790736172.184063:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877722816093568:0@lo:400:kworker.0 00000100:00100000:0.0:1790736172.184153:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736172.184205:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b308380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816094080:0@lo:400:kworker.0 00000100:00100000:0.0:1790736172.184240:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736172.184317:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790736172.184324:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52e04a2b-4e01-44b7-985c-7db034e22389:3307:1877722816093440:0@lo:400:kworker.0 00000100:00100000:0.0:1790736172.184354:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736172.184378:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1877722816093952:0@lo:400:kworker.0 00000100:00100000:0.0:1790736172.184400:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736172.184424:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1877722816093696:0@lo:400:kworker.0 00000100:00100000:0.0:1790736172.184456:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736172.187977:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790736172.187999:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816093824:0@lo:400:kworker.0 00000100:00100000:0.0:1790736172.188067:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736172.188146:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816093568 00000100:00100000:0.0:1790736172.188154:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816093568 00000100:00100000:0.0:1790736172.188200:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816093952 00000100:00100000:0.0:1790736172.188204:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816093952 00000100:00100000:0.0:1790736172.188224:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816093696 00000100:00100000:0.0:1790736172.188239:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816093696 00000100:00100000:0.0:1790736172.188257:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790736172.188264:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877722816093568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736172.188319:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877722816093568:12345-0@lo:400:kworker.0 Request processed in 55us (4167us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736172.188326:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790736172.188342:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790736172.188348:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877722816093952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736172.188375:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877722816093952:12345-0@lo:400:kworker.0 Request processed in 28us (3974us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736172.188380:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790736172.188389:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790736172.188394:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b309c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877722816093696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736172.188424:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b309c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877722816093696:12345-0@lo:400:kworker.0 Request processed in 30us (3968us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736172.188430:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790736172.188447:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816094080 00000100:00100000:0.0:1790736172.188451:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816094080 00000100:00100000:0.0:1790736172.188500:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816093824 00000100:00100000:0.0:1790736172.188503:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816093824 00000100:00100000:0.0:1790736172.188518:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790736172.188523:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816094080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736172.188553:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816094080:12345-0@lo:400:kworker.0 Request processed in 30us (4312us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736172.188559:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790736172.188569:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790736172.188574:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816093824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736172.188596:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816093824:12345-0@lo:400:kworker.0 Request processed in 22us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736172.188601:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790736172.188617:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816093440 00000100:00100000:0.0:1790736172.188620:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816093440 00000100:00100000:0.0:1790736172.188639:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1790736172.188645:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+19:3307:x1877722816093440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736172.188687:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+19:3307:x1877722816093440:12345-0@lo:400:kworker.0 Request processed in 43us (4333us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736172.188694:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:0.0:1790736172.191236:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790736172.191244:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790736172.191291:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163fad5500 x1877722816093824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790736172.191307:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816093824:0@lo:400:kworker.0 00000100:00100000:0.0:1790736172.191320:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1877722816093696:0@lo:400:kworker.0 00000100:00100000:0.0:1790736172.191355:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52e04a2b-4e01-44b7-985c-7db034e22389:3307:1877722816093440:0@lo:400:kworker.0 00000100:00100000:0.0:1790736172.191376:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1877722816093952:0@lo:400:kworker.0 00000100:00100000:0.0:1790736172.191387:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877722816093568:0@lo:400:kworker.0 00010000:00080000:0.0:1790736172.191398:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163b308380 x1877722816094080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790736172.191408:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b308380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816094080:0@lo:400:kworker.0 00000100:00100000:0.0:1790736172.694346:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f242d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816094208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790736172.694414:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736172.694696:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816094208 00000100:00100000:1.0:1790736172.694705:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816094208 00000100:00100000:1.0:1790736172.694847:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790736172.694857:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816094208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790736172.694891:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790736172.694975:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816094208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736172.694984:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1790736172.695532:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94162f242d80 x1877722816094208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736188 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790736172.695553:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f242d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816094208:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790736172.821360:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736173.848609:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790736174.580749:0:9459:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.59.3 00010000:00010000:0.0:1790736174.869423:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736175.894752:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790736176.076058:0:9508:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 29 22:42:55 EDT 2026 00000100:00100000:1.0:1790736176.137934:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736176.138032:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797187072 00000100:00100000:0.0:1790736176.138043:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797187072 00000100:00100000:0.0:1790736176.138479:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 200 00000100:00100000:0.0:1790736176.138490:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+10:2355:x1877722797187072:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1790736176.138567:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+10:2355:x1877722797187072:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 78us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736176.138574:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 200 00000100:00100000:0.0:1790736176.145943:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736176.148429:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797187200 00000100:00100000:1.0:1790736176.148444:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797187200 00000100:00100000:1.0:1790736176.148517:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 49 00000100:00100000:1.0:1790736176.148528:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b308e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2355:x1877722797187200:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1790736176.148605:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b308e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2355:x1877722797187200:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 79us (2672us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736176.148612:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 49 00000100:00080000:0.0:1790736176.149352:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790736176.277345:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790736176.277373:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163ad19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816094336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790736176.277458:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736176.277538:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816094336 00000100:00100000:1.0:1790736176.277545:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816094336 00000100:00080000:0.0:1790736176.277666:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790736176.280723:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790736176.280790:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ad18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816094336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790736176.280835:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790736176.281007:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ad18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816094336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 231us (3549us total) trans 0 rc 0/0 00010000:00080000:1.0:1790736176.281079:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163ad19500 x1877722816094336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736192 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736176.281133:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163ad19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816094336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790736176.290069:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1790736176.918407:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790736177.303117:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b30a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877722816094592:0@lo:400:kworker.0 00000100:00100000:0.0:1790736177.303322:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736177.303402:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b308000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816095104:0@lo:400:kworker.0 00000100:00100000:0.0:1790736177.303435:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736177.303475:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790736177.303482:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b30a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52e04a2b-4e01-44b7-985c-7db034e22389:3307:1877722816094464:0@lo:400:kworker.0 00000100:00100000:0.0:1790736177.303516:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736177.303543:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b309880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1877722816094976:0@lo:400:kworker.0 00000100:00100000:0.0:1790736177.303567:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736177.303598:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b309f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816094848:0@lo:400:kworker.0 00000100:00100000:0.0:1790736177.303625:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736177.303650:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790736177.303656:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1877722816094720:0@lo:400:kworker.0 00000100:00100000:0.0:1790736177.303681:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736177.303717:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816094592 00000100:00100000:0.0:1790736177.303728:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816094592 00000100:00100000:0.0:1790736177.303785:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816094976 00000100:00100000:0.0:1790736177.303789:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816094976 00000100:00100000:0.0:1790736177.303814:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816094720 00000100:00100000:0.0:1790736177.303817:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816094720 00000100:00100000:0.0:1790736177.303834:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790736177.303845:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877722816094592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736177.303918:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877722816094592:12345-0@lo:400:kworker.0 Request processed in 73us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736177.303927:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790736177.303948:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790736177.303955:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877722816094976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736177.303999:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877722816094976:12345-0@lo:400:kworker.0 Request processed in 45us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736177.304006:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790736177.304019:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790736177.304025:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877722816094720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736177.304057:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877722816094720:12345-0@lo:400:kworker.0 Request processed in 32us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736177.304063:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790736177.304082:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816095104 00000100:00100000:0.0:1790736177.304086:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816095104 00000100:00100000:0.0:1790736177.304142:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816094848 00000100:00100000:0.0:1790736177.304145:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816094848 00000100:00100000:0.0:1790736177.304167:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790736177.304174:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816095104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736177.304221:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816095104:12345-0@lo:400:kworker.0 Request processed in 47us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736177.304227:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790736177.304238:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790736177.304244:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816094848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736177.304760:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816094848:12345-0@lo:400:kworker.0 Request processed in 515us (1132us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736177.304770:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790736177.304802:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816094464 00000100:00100000:0.0:1790736177.304809:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816094464 00000100:00100000:0.0:1790736177.304887:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1790736177.304895:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+19:3307:x1877722816094464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736177.304947:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+19:3307:x1877722816094464:12345-0@lo:400:kworker.0 Request processed in 52us (1429us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736177.304954:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:1.0:1790736177.307398:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790736177.307412:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790736177.307495:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b30a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52e04a2b-4e01-44b7-985c-7db034e22389:3307:1877722816094464:0@lo:400:kworker.0 00000100:00100000:1.0:1790736177.307525:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b309880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1877722816094976:0@lo:400:kworker.0 00000100:00100000:1.0:1790736177.307543:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b30a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877722816094592:0@lo:400:kworker.0 00010000:00080000:1.0:1790736177.307562:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163b308000 x1877722816095104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736177.307586:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b308000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816095104:0@lo:400:kworker.0 00000100:00100000:3.0:1790736177.307843:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1877722816094720:0@lo:400:kworker.0 00010000:00080000:3.0:1790736177.307862:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163b309f80 x1877722816094848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736177.307872:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b309f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816094848:0@lo:400:kworker.0 00000100:00100000:1.0:1790736177.821676:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b309f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816095232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790736177.821782:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736177.824720:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816095232 00000100:00100000:0.0:1790736177.824738:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816095232 00000100:00100000:0.0:1790736177.824820:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790736177.824832:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ad19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816095232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790736177.824884:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790736177.824997:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ad19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816095232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 168us (3214us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736177.825005:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1790736177.825070:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163b309f80 x1877722816095232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736193 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790736177.825119:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b309f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816095232:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790736177.941823:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736178.966478:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736179.990519:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736181.013371:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736181.246969:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736181.247022:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736181.247049:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797187456 00000100:00100000:3.0:1790736181.247058:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797187456 00000100:00100000:3.0:1790736181.247143:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 53 00000100:00100000:3.0:1790736181.247154:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2354:x1877722797187456:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736181.247239:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2354:x1877722797187456:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 86us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736181.247247:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 53 00000100:00100000:3.0:1790736181.247271:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797187328 00000100:00100000:3.0:1790736181.247274:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797187328 00000100:00100000:3.0:1790736181.247298:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 202 00000100:00100000:3.0:1790736181.247305:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+10:2354:x1877722797187328:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736181.247481:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+10:2354:x1877722797187328:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 25us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736181.247488:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 202 00000100:00080000:1.0:1790736181.249499:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790736181.397460:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163ad1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816095360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790736181.397536:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736181.397699:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816095360 00000100:00100000:0.0:1790736181.397707:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816095360 00000100:00100000:0.0:1790736181.397771:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790736181.397780:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f240e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816095360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790736181.397816:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1790736181.397887:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790736181.402737:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f240e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816095360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4949us (5191us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736181.402750:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1790736181.402957:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163ad1a680 x1877722816095360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736197 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736181.402984:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163ad1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816095360:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790736182.039966:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736182.422821:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1877722816095744:0@lo:400:kworker.0 00000100:00100000:3.0:1790736182.422931:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736182.423024:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790736182.423031:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816095872:0@lo:400:kworker.0 00000100:00100000:3.0:1790736182.423063:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736182.423143:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816095744 00000100:00100000:3.0:1790736182.423164:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816095744 00000100:00100000:3.0:1790736182.423246:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790736182.423257:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162ed90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877722816095744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736182.423325:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162ed90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877722816095744:12345-0@lo:400:kworker.0 Request processed in 70us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736182.423332:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790736182.423364:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816095872 00000100:00100000:3.0:1790736182.423367:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816095872 00000100:00100000:3.0:1790736182.423397:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790736182.423405:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162ed92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816095872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736182.423410:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877722816095616:0@lo:400:kworker.0 00000100:00100000:3.0:1790736182.423449:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162ed92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816095872:12345-0@lo:400:kworker.0 Request processed in 44us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736182.423459:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790736182.423473:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790736182.423480:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790736182.423517:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94162ed90a80 x1877722816095872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790736182.423525:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816096128:0@lo:400:kworker.0 00000100:00100000:3.0:1790736182.423537:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816095872:0@lo:400:kworker.0 00000100:00100000:3.0:1790736182.423553:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1877722816095744:0@lo:400:kworker.0 00000100:00100000:0.0:1790736182.423561:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736182.423605:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790736182.423612:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f242d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52e04a2b-4e01-44b7-985c-7db034e22389:3307:1877722816095488:0@lo:400:kworker.0 00000100:00100000:0.0:1790736182.423646:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736182.423681:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816095488 00000100:00100000:0.0:1790736182.423686:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1877722816096000:0@lo:400:kworker.0 00000100:00100000:2.0:1790736182.423688:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816095488 00000100:00100000:0.0:1790736182.423721:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736182.423751:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816095616 00000100:00100000:0.0:1790736182.423756:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816095616 00000100:00100000:3.0:1790736182.423969:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816096128 00000100:00100000:3.0:1790736182.423983:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816096128 00000100:00100000:3.0:1790736182.424018:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790736182.424026:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816096128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736182.424070:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816096128:12345-0@lo:400:kworker.0 Request processed in 45us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736182.424078:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790736182.429862:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1790736182.429862:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816096000 00000100:00100000:0.0:1790736182.429882:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816096000 00000100:00100000:2.0:1790736182.429899:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+19:3307:x1877722816095488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736182.430056:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+19:3307:x1877722816095488:12345-0@lo:400:kworker.0 Request processed in 177us (6409us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736182.430079:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1790736182.430684:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790736182.430697:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790736182.430704:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b309f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877722816095616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736182.430718:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b308000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877722816096000:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1790736182.430895:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790736182.430902:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790736182.430953:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f242d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52e04a2b-4e01-44b7-985c-7db034e22389:3307:1877722816095488:0@lo:400:kworker.0 00010000:00080000:3.0:1790736182.430986:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94162ed93b80 x1877722816096128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736182.431005:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816096128:0@lo:400:kworker.0 00000100:00100000:1.0:1790736182.436645:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b308000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877722816096000:12345-0@lo:400:kworker.0 Request processed in 5922us (12910us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736182.436665:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790736182.440857:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b309f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877722816095616:12345-0@lo:400:kworker.0 Request processed in 10146us (17382us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736182.440876:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790736182.442402:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1877722816096000:0@lo:400:kworker.0 00000100:00100000:2.0:1790736182.442777:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877722816095616:0@lo:400:kworker.0 00000100:00100000:3.0:1790736182.936619:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790736182.936649:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816096256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790736182.936745:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736182.936956:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816096256 00000100:00100000:3.0:1790736182.936968:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816096256 00000100:00100000:3.0:1790736182.937297:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790736182.937311:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162ed91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816096256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790736182.937370:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790736182.937434:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162ed91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816096256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736182.940708:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1790736182.941514:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94162ed93b80 x1877722816096256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736198 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736182.941567:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816096256:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790736183.065777:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736184.085295:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736185.117705:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736186.133681:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736186.374183:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736186.374245:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736186.374442:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797187712 00000100:00100000:2.0:1790736186.374457:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797187712 00000100:00100000:2.0:1790736186.374556:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 57 00000100:00100000:2.0:1790736186.374568:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ad1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2353:x1877722797187712:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1790736186.374673:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ad1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2353:x1877722797187712:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 107us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736186.374692:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 57 00000100:00080000:0.0:1790736186.375288:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790736186.375564:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797187584 00000100:00100000:3.0:1790736186.375573:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797187584 00000100:00100000:3.0:1790736186.375625:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 204 00000100:00100000:3.0:1790736186.375634:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+10:2353:x1877722797187584:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736186.375711:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+10:2353:x1877722797187584:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 77us (1544us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736186.375719:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 204 00000100:00100000:0.0:1790736186.517737:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790736186.517771:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b30a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816096384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790736186.517869:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736186.517956:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816096384 00000100:00100000:0.0:1790736186.517966:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816096384 00000100:00100000:0.0:1790736186.519605:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790736186.519622:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b309880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816096384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790736186.519674:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790736186.519770:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b309880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816096384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (1900us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736186.519786:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1790736186.519839:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790736186.522270:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163b30a300 x1877722816096384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736202 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736186.522320:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b30a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816096384:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790736187.157280:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736187.544885:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633e87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816096512:0@lo:400:kworker.0 00000100:00100000:3.0:1790736187.544998:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736187.545135:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816096512 00000100:00100000:0.0:1790736187.545144:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816096512 00000100:00100000:0.0:1790736187.545202:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1790736187.545212:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+19:3306:x1877722816096512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736187.551684:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633e86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877722816096640:0@lo:400:kworker.0 00000100:00100000:1.0:1790736187.551766:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736187.551827:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816096640 00000100:00100000:1.0:1790736187.551834:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816096640 00000100:00100000:1.0:1790736187.551881:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790736187.551890:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ad18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877722816096640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736187.551951:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ad18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877722816096640:12345-0@lo:400:kworker.0 Request processed in 61us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736187.551987:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790736187.552038:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633e86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877722816096640:0@lo:400:kworker.0 00000100:00100000:3.0:1790736187.554531:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633e87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816096512:0@lo:400:kworker.0 00000100:00100000:0.0:1790736187.554531:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+19:3306:x1877722816096512:12345-0@lo:400:kworker.0 Request processed in 9312us (9525us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736187.554550:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1790736187.559925:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633e86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1877722816096768:0@lo:400:kworker.0 00000100:00100000:3.0:1790736187.560005:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633e85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816096896:0@lo:400:kworker.0 00000100:00100000:3.0:1790736187.560061:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736187.560061:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736187.560147:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633e86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816097152:0@lo:400:kworker.0 00000100:00100000:3.0:1790736187.560153:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816096896 00000100:00100000:3.0:1790736187.560176:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816096896 00000100:00100000:1.0:1790736187.560176:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736187.560201:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790736187.560208:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633e87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1877722816097024:0@lo:400:kworker.0 00000100:00100000:3.0:1790736187.560220:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816097152 00000100:00100000:3.0:1790736187.560225:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816097152 00000100:00100000:1.0:1790736187.560236:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736187.560260:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790736187.560268:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816096768 00000100:00100000:3.0:1790736187.560273:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162ed93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816096896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736187.560275:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816096768 00000100:00100000:1.0:1790736187.560309:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816097024 00000100:00100000:1.0:1790736187.560314:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816097024 00000100:00100000:3.0:1790736187.560335:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162ed93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816096896:12345-0@lo:400:kworker.0 Request processed in 66us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736187.560345:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790736187.560352:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790736187.560363:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ad19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877722816096768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736187.560379:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790736187.560387:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ad1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816097152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736187.560408:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ad19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877722816096768:12345-0@lo:400:kworker.0 Request processed in 47us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736187.560416:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790736187.560434:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790736187.560437:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ad1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816097152:12345-0@lo:400:kworker.0 Request processed in 49us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736187.560445:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ad1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877722816097024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736187.560446:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1790736187.560473:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790736187.560479:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790736187.560498:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ad1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877722816097024:12345-0@lo:400:kworker.0 Request processed in 54us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736187.560508:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:3.0:1790736187.560509:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff941633e85500 x1877722816096896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736187.560523:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633e85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816096896:0@lo:400:kworker.0 00000100:00100000:1.0:1790736187.560561:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633e86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1877722816096768:0@lo:400:kworker.0 00000100:00100000:3.0:1790736187.560562:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633e87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1877722816097024:0@lo:400:kworker.0 00010000:00080000:3.0:1790736187.560581:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff941633e86d80 x1877722816097152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736187.560588:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633e86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816097152:0@lo:400:kworker.0 00000100:00100000:3.0:1790736188.053267:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816097280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790736188.053335:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736188.053495:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816097280 00000100:00100000:3.0:1790736188.053731:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816097280 00000100:00100000:3.0:1790736188.053786:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790736188.053795:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162ed93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816097280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790736188.053833:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790736188.053881:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162ed93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816097280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736188.053888:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1790736188.053928:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94162ed90a80 x1877722816097280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736204 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736188.053961:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816097280:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790736188.181787:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736189.216479:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736190.230607:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736191.253239:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736191.488884:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736191.488960:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736191.489149:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797187840 00000100:00100000:0.0:1790736191.489163:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797187840 00000100:00100000:0.0:1790736191.489233:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 206 00000100:00100000:0.0:1790736191.489245:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+10:2356:x1877722797187840:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1790736191.489343:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+10:2356:x1877722797187840:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 100us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736191.489352:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 206 00000100:00100000:2.0:1790736191.492478:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797187968 00000100:00100000:2.0:1790736191.492502:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797187968 00000100:00100000:2.0:1790736191.492613:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 61 00000100:00100000:2.0:1790736191.492625:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ad19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2356:x1877722797187968:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1790736191.492751:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ad19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2356:x1877722797187968:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 129us (3884us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736191.492761:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 61 00000100:00080000:3.0:1790736191.492965:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790736191.639568:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790736191.639599:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163ad19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816097408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790736191.639681:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736191.639903:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816097408 00000100:00100000:3.0:1790736191.639911:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816097408 00000100:00100000:3.0:1790736191.639981:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790736191.639991:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816097408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790736191.640027:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1790736191.640029:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790736191.640112:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816097408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736191.640120:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1790736191.640161:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163ad19880 x1877722816097408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736207 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790736191.640184:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163ad19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816097408:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1790736191.789198:0:10139:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 22:43:10 (1790736190) === 00000100:00100000:3.0:1790736192.215185:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736192.215362:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797188096 00000100:00100000:0.0:1790736192.215377:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797188096 00000100:00100000:0.0:1790736192.215465:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 207 00000100:00100000:0.0:1790736192.215479:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+10:8109:x1877722797188096:12345-192.168.203.5@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790736192.215505:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736192.215535:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941600031200/0x6aae200528fe62a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x92962417a526ce5 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736192.215576:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941600031200/0x6aae200528fe62a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526ce5 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736192.215613:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941600031200/0x6aae200528fe62a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526ce5 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736192.215624:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941600031200, rc 0) 00000100:00100000:0.0:1790736192.215701:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+11:8109:x1877722797188096:12345-192.168.203.5@tcp:101:mount.lustre.0 Request processed in 224us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736192.215709:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 207 00000100:00100000:0.0:1790736192.225839:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736192.226820:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797188224 00000100:00100000:1.0:1790736192.226835:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797188224 00000100:00100000:1.0:1790736192.227065:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 208 00000100:00100000:1.0:1790736192.227087:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+11:8109:x1877722797188224:12345-192.168.203.5@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790736192.228843:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+11:8109:x1877722797188224:12345-192.168.203.5@tcp:501:mount.lustre.0 Request processed in 1755us (3007us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736192.228857:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 208 00000100:00100000:3.0:1790736192.232905:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736192.233528:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797188352 00000100:00100000:0.0:1790736192.233545:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797188352 00000100:00100000:0.0:1790736192.233689:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 209 00000100:00100000:0.0:1790736192.233702:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+11:8109:x1877722797188352:12345-192.168.203.5@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790736192.234940:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+11:8109:x1877722797188352:12345-192.168.203.5@tcp:503:mount.lustre.0 Request processed in 1231us (2039us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736192.234953:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 209 00000100:00100000:3.0:1790736192.244835:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736192.246118:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797188480 00000100:00100000:1.0:1790736192.246137:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797188480 00000100:00100000:1.0:1790736192.246585:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 210 00000100:00100000:1.0:1790736192.246604:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+11:8113:x1877722797188480:12345-192.168.203.5@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790736192.247658:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+11:8113:x1877722797188480:12345-192.168.203.5@tcp:502:llog_process_th.0 Request processed in 1051us (2831us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736192.248145:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 210 00000100:00100000:2.0:1790736192.263977:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736192.266554:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797188608 00000100:00100000:0.0:1790736192.266576:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797188608 00000100:00100000:0.0:1790736192.266671:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 211 00000100:00100000:0.0:1790736192.266685:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+11:8113:x1877722797188608:12345-192.168.203.5@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790736192.267079:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+11:8113:x1877722797188608:12345-192.168.203.5@tcp:502:llog_process_th.0 Request processed in 395us (3119us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736192.267157:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 211 00000100:00100000:3.0:1790736192.275067:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736192.275189:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797188736 00000100:00100000:1.0:1790736192.275202:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797188736 00000100:00100000:1.0:1790736192.275276:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 212 00000100:00100000:1.0:1790736192.275288:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+11:8109:x1877722797188736:12345-192.168.203.5@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790736192.275313:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736192.275347:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941633c60000/0x6aae200528fe62ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x92962417a526d0f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736192.275398:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941633c60000/0x6aae200528fe62ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d0f expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736192.275435:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941633c60000/0x6aae200528fe62ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d0f expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736192.275446:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c60000, rc 0) 00000100:00100000:1.0:1790736192.276078:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+12:8109:x1877722797188736:12345-192.168.203.5@tcp:101:mount.lustre.0 Request processed in 788us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736192.276119:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 212 00010000:00010000:1.0:1790736192.282895:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790736192.286611:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736192.287595:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797188864 00000100:00100000:0.0:1790736192.287612:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797188864 00000100:00100000:0.0:1790736192.287690:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 213 00000100:00100000:0.0:1790736192.287720:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+12:8109:x1877722797188864:12345-192.168.203.5@tcp:256:mount.lustre.0 20000000:01000000:0.0:1790736192.287827:0:5837:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1790736192.287852:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1790736192.287857:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1790736192.287861:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1790736192.287863:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1790736192.293620:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+12:8109:x1877722797188864:12345-192.168.203.5@tcp:256:mount.lustre.0 Request processed in 5886us (7008us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736192.293640:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 213 00000100:00100000:1.0:1790736192.298625:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736192.298980:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797188992 00000100:00100000:3.0:1790736192.298995:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797188992 00000100:00100000:3.0:1790736192.299598:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 214 00000100:00100000:3.0:1790736192.299613:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+12:8109:x1877722797188992:12345-192.168.203.5@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790736192.299636:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736192.299660:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94162f8c9400/0x6aae200528fe62b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x92962417a526d16 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736192.299701:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94162f8c9400/0x6aae200528fe62b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d16 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736192.299740:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94162f8c9400/0x6aae200528fe62b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d16 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736192.299751:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c9400, rc 0) 00000100:00100000:3.0:1790736192.299886:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+13:8109:x1877722797188992:12345-192.168.203.5@tcp:101:mount.lustre.0 Request processed in 276us (1275us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736192.299895:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 214 00000100:00100000:0.0:1790736192.308286:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736192.308426:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797189120 00000100:00100000:2.0:1790736192.308443:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797189120 00000100:00100000:2.0:1790736192.308528:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 215 00000100:00100000:2.0:1790736192.308542:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+13:8109:x1877722797189120:12345-192.168.203.5@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790736192.309819:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+13:8109:x1877722797189120:12345-192.168.203.5@tcp:501:mount.lustre.0 Request processed in 1265us (1543us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736192.309836:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 215 00000100:00100000:0.0:1790736192.323298:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736192.326552:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797189248 00000100:00100000:3.0:1790736192.326574:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797189248 00000100:00100000:3.0:1790736192.326669:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 216 00000100:00100000:3.0:1790736192.326681:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+13:8109:x1877722797189248:12345-192.168.203.5@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790736192.333479:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+13:8109:x1877722797189248:12345-192.168.203.5@tcp:503:mount.lustre.0 Request processed in 6780us (10176us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736192.333499:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 216 00000100:00100000:1.0:1790736192.340919:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736192.341005:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797189376 00000100:00100000:0.0:1790736192.341019:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797189376 00000100:00100000:0.0:1790736192.341149:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 217 00000100:00100000:0.0:1790736192.341161:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+13:8118:x1877722797189376:12345-192.168.203.5@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790736192.341484:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+13:8118:x1877722797189376:12345-192.168.203.5@tcp:502:llog_process_th.0 Request processed in 324us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736192.341493:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 217 00000100:00100000:0.0:1790736192.348808:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736192.349038:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797189504 00000100:00100000:2.0:1790736192.349049:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797189504 00000100:00100000:2.0:1790736192.349145:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 218 00000100:00100000:2.0:1790736192.349155:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+13:8118:x1877722797189504:12345-192.168.203.5@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790736192.349425:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+13:8118:x1877722797189504:12345-192.168.203.5@tcp:502:llog_process_th.0 Request processed in 270us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736192.349434:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 218 00000100:00100000:3.0:1790736192.353872:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736192.353913:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736192.353988:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797189632 00000100:00100000:1.0:1790736192.354006:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797189632 00000100:00100000:0.0:1790736192.354040:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797190016 00000100:00100000:0.0:1790736192.354051:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797190016 00000100:00100000:1.0:1790736192.354144:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 10 00000100:00100000:1.0:1790736192.354156:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162ed90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2352:x1877722797189632:12345-192.168.203.5@tcp:38:mount.lustre.0 00010000:00080000:1.0:1790736192.354196:0:5844:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af@192.168.203.5@tcp t0 exp 0000000000000000 cur 264 last 0 00000100:00100000:0.0:1790736192.354439:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 62 00000100:00100000:0.0:1790736192.354452:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162ed91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2353:x1877722797190016:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1790736192.354567:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162ed91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2353:x1877722797190016:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 119us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736192.354576:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 62 00000020:00000080:1.0:1790736192.354822:0:5844:0:(genops.c:1384:class_connect()) connect: client d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af, cookie 0x6aae200528fe62bb 00000004:00100000:1.0:1790736192.354866:0:5844:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1790736192.355434:0:5844:0:(import.c:65:import_set_state_nolock()) ffff941633c50000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790736192.355521:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162ed90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+6:2352:x1877722797189632:12345-192.168.203.5@tcp:38:mount.lustre.0 Request processed in 1364us (1656us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736192.355533:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 10 00000100:00100000:1.0:1790736192.361408:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736192.361617:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797189760 00000100:00100000:2.0:1790736192.361688:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797189760 00000100:00100000:2.0:1790736192.361822:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 11 00000100:00100000:2.0:1790736192.361832:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ad19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+6:0:x1877722797189760:12345-192.168.203.5@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790736192.361887:0:5843:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790736192.364891:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ad19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+6:0:x1877722797189760:12345-192.168.203.5@tcp:41:mount.lustre.0 Request processed in 3039us (3473us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736192.364906:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 11 00000100:00080000:3.0:1790736192.370659:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790736192.370866:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736192.371853:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797189888 00000100:00100000:1.0:1790736192.371866:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797189888 00000100:00100000:2.0:1790736192.372077:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 12 00000100:00100000:2.0:1790736192.372127:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+6:8109:x1877722797189888:12345-192.168.203.5@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790736192.372157:0:5844:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790736192.372217:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+6:8109:x1877722797189888:12345-192.168.203.5@tcp:41:mount.lustre.0 Request processed in 123us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736192.372235:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 12 00000100:00100000:0.0:1790736192.373869:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736192.374015:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797190144 00000100:00100000:1.0:1790736192.374023:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797190144 00000100:00100000:1.0:1790736192.374313:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 13 00000100:00100000:1.0:1790736192.374324:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+6:8109:x1877722797190144:12345-192.168.203.5@tcp:40:mount.lustre.0 00000100:00100000:1.0:1790736192.374519:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+6:8109:x1877722797190144:12345-192.168.203.5@tcp:40:mount.lustre.0 Request processed in 196us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736192.374527:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 13 00000100:00100000:1.0:1790736192.381754:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736192.381793:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736192.381898:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797190272 00000100:00100000:0.0:1790736192.381908:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797190272 00000100:00100000:0.0:1790736192.381966:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797190400 00000100:00100000:0.0:1790736192.381969:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797190400 00000100:00100000:0.0:1790736192.381995:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 12 00000100:00100000:0.0:1790736192.382003:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1877722797190272:12345-192.168.203.5@tcp:8:mount.lustre.0 00000100:00100000:2.0:1790736192.382156:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 13 00000100:00100000:2.0:1790736192.382162:0:8632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2352:x1877722797190400:12345-192.168.203.5@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790736192.382403:0:6699:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af@192.168.203.5@tcp t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:0.0:1790736192.382439:0:6699:0:(genops.c:1384:class_connect()) connect: client d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af, cookie 0x6aae200528fe62c2 00002000:00100000:0.0:1790736192.382452:0:6699:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af/ffff941635cdc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790736192.382462:0:6699:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790736192.382693:0:6699:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790736192.382725:0:6699:0:(import.c:65:import_set_state_nolock()) ffff941635cd9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790736192.382788:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+6:2352:x1877722797190272:12345-192.168.203.5@tcp:8:mount.lustre.0 Request processed in 784us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736192.382797:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 12 00000100:00100000:1.0:1790736192.384304:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736192.385013:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797190528 00000100:00100000:3.0:1790736192.385034:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797190528 00000100:00100000:3.0:1790736192.385130:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1 00000100:00100000:3.0:1790736192.385141:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+6:8109:x1877722797190528:12345-192.168.203.5@tcp:33:mount.lustre.0 00000004:00200000:3.0:1790736192.385210:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1790736192.385292:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+6:8109:x1877722797190528:12345-192.168.203.5@tcp:33:mount.lustre.0 Request processed in 153us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736192.385300:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1 00010000:00080000:2.0:1790736192.386827:0:8632:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af@192.168.203.5@tcp t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:2.0:1790736192.386861:0:8632:0:(genops.c:1384:class_connect()) connect: client d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af, cookie 0x6aae200528fe62c9 00002000:00100000:2.0:1790736192.386873:0:8632:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af/ffff94162d363000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790736192.386895:0:8632:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790736192.389650:0:8632:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790736192.389694:0:8632:0:(import.c:65:import_set_state_nolock()) ffff94162d362800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790736192.389837:0:8632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+6:2352:x1877722797190400:12345-192.168.203.5@tcp:8:mount.lustre.0 Request processed in 7671us (8041us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736192.389848:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 13 00000100:00100000:1.0:1790736192.665395:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790736192.665479:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790736192.665499:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877722816097664:0@lo:400:kworker.0 00000100:00100000:0.0:1790736192.665586:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736192.666240:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816097664 00000100:00100000:2.0:1790736192.666250:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816097664 00000100:00100000:2.0:1790736192.666315:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790736192.666325:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877722816097664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736192.666411:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877722816097664:12345-0@lo:400:kworker.0 Request processed in 87us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736192.666418:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790736192.666464:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877722816097664:0@lo:400:kworker.0 00000100:00100000:1.0:1790736192.676075:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52e04a2b-4e01-44b7-985c-7db034e22389:3307:1877722816097536:0@lo:400:kworker.0 00000100:00100000:1.0:1790736192.676199:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736192.676352:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816097536 00000100:00100000:0.0:1790736192.676362:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816097536 00000100:00100000:0.0:1790736192.676411:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1790736192.676421:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606656850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+19:3307:x1877722816097536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736192.676488:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606656850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+19:3307:x1877722816097536:12345-0@lo:400:kworker.0 Request processed in 69us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736192.676495:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1790736192.677712:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52e04a2b-4e01-44b7-985c-7db034e22389:3307:1877722816097536:0@lo:400:kworker.0 00000100:00100000:3.0:1790736192.677942:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816097920:0@lo:400:kworker.0 00000100:00100000:3.0:1790736192.677995:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736192.678020:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790736192.678038:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1877722816097792:0@lo:400:kworker.0 00000100:00100000:3.0:1790736192.678069:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736192.678179:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1877722816098048:0@lo:400:kworker.0 00000100:00100000:2.0:1790736192.678210:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736192.678236:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790736192.678241:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f242d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816098176:0@lo:400:kworker.0 00000100:00100000:2.0:1790736192.678263:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736192.678345:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816097920 00000100:00100000:0.0:1790736192.678352:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816097920 00000100:00100000:0.0:1790736192.678396:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816098176 00000100:00100000:0.0:1790736192.678399:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816098176 00000100:00100000:0.0:1790736192.678427:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790736192.678434:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163381b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816097920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736192.678484:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163381b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816097920:12345-0@lo:400:kworker.0 Request processed in 50us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736192.678491:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790736192.678507:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790736192.678513:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816098176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736192.678542:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816098176:12345-0@lo:400:kworker.0 Request processed in 29us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736192.678561:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1790736192.678690:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94162f242d80 x1877722816098176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790736192.678702:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f242d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816098176:0@lo:400:kworker.0 00000100:00100000:1.0:1790736192.678773:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816097792 00000100:00100000:1.0:1790736192.678778:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816097792 00000100:00100000:1.0:1790736192.678809:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816098048 00000100:00100000:1.0:1790736192.678812:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816098048 00000100:00100000:1.0:1790736192.678835:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790736192.678842:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163381ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877722816097792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736192.678874:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163381ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877722816097792:12345-0@lo:400:kworker.0 Request processed in 33us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736192.678880:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790736192.678891:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790736192.678897:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877722816098048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736192.678926:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877722816098048:12345-0@lo:400:kworker.0 Request processed in 30us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736192.678931:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790736192.678969:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1877722816098048:0@lo:400:kworker.0 00000100:00080000:3.0:1790736192.679126:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790736192.679131:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790736192.679150:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1877722816097792:0@lo:400:kworker.0 00010000:00080000:3.0:1790736192.679161:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94162ed92d80 x1877722816097920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736192.679170:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816097920:0@lo:400:kworker.0 00000100:00100000:2.0:1790736193.173304:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633819500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816098304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790736193.173383:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736193.173515:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816098304 00000100:00100000:1.0:1790736193.173524:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816098304 00000100:00100000:1.0:1790736193.173579:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790736193.173588:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816098304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790736193.173616:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790736193.174440:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816098304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 848us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736193.174449:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1790736193.183361:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff941633819500 x1877722816098304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736209 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790736193.183390:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633819500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816098304:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790736193.301233:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736194.326165:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790736195.325715:0:6725:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af 00010000:00010000:3.0:1790736195.349530:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790736195.819611:0:5867:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af 00000001:00100000:2.0:1790736196.286217:0:7658:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af 00010000:00010000:3.0:1790736196.373239:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736196.757677:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b6c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816098432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790736196.757746:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736196.757869:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816098432 00000100:00100000:0.0:1790736196.757877:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816098432 00000100:00100000:0.0:1790736196.757939:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790736196.757949:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633819c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816098432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790736196.757981:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790736196.758024:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633819c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816098432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736196.758032:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1790736196.758115:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790736196.758143:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163b6c6d80 x1877722816098432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736212 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736196.758159:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b6c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816098432:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790736197.404639:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790736197.634305:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736197.634346:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736197.634371:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736197.634390:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736197.634397:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797190912 00000100:00100000:1.0:1790736197.634407:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797190912 00000100:00100000:0.0:1790736197.634410:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736197.634427:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797191168 00000100:00100000:0.0:1790736197.634442:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797191168 00000100:00100000:1.0:1790736197.634457:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797190784 00000100:00100000:1.0:1790736197.634460:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797190784 00000100:00100000:0.0:1790736197.634465:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797191040 00000100:00100000:0.0:1790736197.634468:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797191040 00000100:00100000:1.0:1790736197.634483:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 66 00000100:00100000:0.0:1790736197.634485:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 37 00000100:00100000:0.0:1790736197.634492:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2355:x1877722797191168:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1790736197.634502:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2355:x1877722797190912:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1790736197.634561:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2355:x1877722797190912:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 69us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736197.634569:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 66 00000100:00100000:1.0:1790736197.634584:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 67 00000100:00100000:1.0:1790736197.634589:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2355:x1877722797190784:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1790736197.636317:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2355:x1877722797191168:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 1816us (1935us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736197.636329:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 37 00000100:00100000:0.0:1790736197.636357:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 38 00000100:00100000:0.0:1790736197.636367:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2355:x1877722797191040:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1790736197.636406:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2355:x1877722797191040:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 42us (1995us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736197.636413:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 38 00000100:00080000:0.0:1790736197.636459:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790736197.636464:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790736197.636467:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790736197.637252:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797190656 00000100:00100000:2.0:1790736197.637270:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797190656 00000100:00100000:2.0:1790736197.637316:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 220 00000100:00100000:2.0:1790736197.637323:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606657c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+13:2355:x1877722797190656:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1790736197.637373:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606657c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+13:2355:x1877722797190656:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 50us (3077us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736197.637379:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 220 00000100:00100000:1.0:1790736197.641480:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2355:x1877722797190784:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 6878us (7076us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736197.641511:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 67 00000100:00100000:2.0:1790736197.782437:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633819500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1877722816098816:0@lo:400:kworker.0 00000100:00100000:2.0:1790736197.782522:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736197.782637:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633819880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877722816098688:0@lo:400:kworker.0 00000100:00100000:0.0:1790736197.782667:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736197.782693:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790736197.782699:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163381aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52e04a2b-4e01-44b7-985c-7db034e22389:3307:1877722816098560:0@lo:400:kworker.0 00000100:00100000:0.0:1790736197.782725:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736197.782762:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816098816 00000100:00100000:0.0:1790736197.782770:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816098816 00000100:00100000:0.0:1790736197.782819:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816098688 00000100:00100000:0.0:1790736197.782822:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816098688 00000100:00100000:0.0:1790736197.782844:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790736197.782853:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877722816098816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736197.788784:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816098944:0@lo:400:kworker.0 00000100:00100000:3.0:1790736197.788855:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736197.788997:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1877722816099072:0@lo:400:kworker.0 00000100:00100000:1.0:1790736197.789031:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736197.789070:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790736197.789076:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b30c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816099200:0@lo:400:kworker.0 00000100:00100000:1.0:1790736197.789134:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736197.789787:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816098944 00000100:00100000:3.0:1790736197.789796:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816098944 00000100:00100000:3.0:1790736197.789849:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816099200 00000100:00100000:3.0:1790736197.789852:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816099200 00000100:00100000:3.0:1790736197.789889:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790736197.789987:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790736197.789997:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816099200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736197.790078:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816099200:12345-0@lo:400:kworker.0 Request processed in 83us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736197.790085:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1790736197.790150:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163b30c700 x1877722816099200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736197.790165:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b30c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816099200:0@lo:400:kworker.0 00000100:00100000:3.0:1790736197.790218:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816098944:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1790736197.790356:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94162ed92d80 x1877722816098944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736197.790368:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816098944:0@lo:400:kworker.0 00000100:00100000:3.0:1790736197.790481:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816098944:12345-0@lo:400:kworker.0 Request processed in 584us (1626us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736197.790487:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790736197.790720:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877722816098816:12345-0@lo:400:kworker.0 Request processed in 7866us (8196us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736197.790729:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790736197.790744:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816099072 00000100:00100000:0.0:1790736197.790749:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816099072 00000100:00100000:0.0:1790736197.790770:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790736197.790776:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877722816098688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736197.790814:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877722816098688:12345-0@lo:400:kworker.0 Request processed in 38us (8146us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736197.790820:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790736197.790831:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790736197.790836:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877722816099072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736197.790879:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877722816099072:12345-0@lo:400:kworker.0 Request processed in 43us (1847us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736197.790885:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1790736197.791023:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790736197.791028:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790736197.791074:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633819880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877722816098688:0@lo:400:kworker.0 00000100:00100000:0.0:1790736197.791150:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816098560 00000100:00100000:0.0:1790736197.791154:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816098560 00000100:00100000:0.0:1790736197.793592:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1790736197.793615:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606654c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+19:3307:x1877722816098560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736197.793701:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606654c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+19:3307:x1877722816098560:12345-0@lo:400:kworker.0 Request processed in 98us (10974us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736197.793853:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1877722816099072:0@lo:400:kworker.0 00000100:00100000:2.0:1790736197.794647:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633819500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1877722816098816:0@lo:400:kworker.0 00000100:00100000:1.0:1790736197.796250:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163381aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52e04a2b-4e01-44b7-985c-7db034e22389:3307:1877722816098560:0@lo:400:kworker.0 00000100:00100000:0.0:1790736197.796888:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000001:02000400:0.0:1790736198.025870:0:10333:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg305-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:2.0:1790736198.294848:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b30d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816099328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790736198.294922:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736198.295499:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816099328 00000100:00100000:3.0:1790736198.295508:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816099328 00000100:00100000:3.0:1790736198.295559:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790736198.295569:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816099328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790736198.295604:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790736198.295658:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816099328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736198.295665:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1790736198.295747:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163b30d500 x1877722816099328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736214 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790736198.295766:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b30d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816099328:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790736198.421468:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736199.445195:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736200.472972:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736201.497366:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790736201.886413:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b6c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816099456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790736201.886481:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736201.886641:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816099456 00000100:00100000:3.0:1790736201.886649:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816099456 00000100:00100000:3.0:1790736201.886714:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790736201.886724:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163381aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816099456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790736201.886765:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1790736201.886833:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790736201.893286:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163381aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816099456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6554us (6794us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736201.893303:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1790736201.898074:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163b6c4e00 x1877722816099456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736217 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790736201.898256:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b6c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816099456:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790736202.520414:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790736202.751420:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736202.751470:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736202.751497:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736202.751537:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736202.751570:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736202.751598:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797191296 00000100:00100000:0.0:1790736202.751608:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797191296 00000100:00100000:0.0:1790736202.751654:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 222 00000100:00100000:0.0:1790736202.751664:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606657050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+13:2355:x1877722797191296:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1790736202.751729:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606657050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+13:2355:x1877722797191296:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 66us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736202.751738:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 222 00000100:00100000:0.0:1790736202.751775:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797191424 00000100:00100000:0.0:1790736202.751779:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797191424 00000100:00100000:0.0:1790736202.751810:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797191552 00000100:00100000:0.0:1790736202.751813:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797191552 00000100:00100000:0.0:1790736202.751831:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 71 00000100:00100000:0.0:1790736202.751838:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633819500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2355:x1877722797191424:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1790736202.751868:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633819500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2355:x1877722797191424:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 30us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736202.751885:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 71 00000100:00100000:0.0:1790736202.751899:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 72 00000100:00100000:0.0:1790736202.751905:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160312f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2355:x1877722797191552:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1790736202.751930:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160312f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2355:x1877722797191552:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 25us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736202.751936:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 72 00000100:00080000:0.0:1790736202.752077:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790736202.752367:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797191680 00000100:00100000:3.0:1790736202.752374:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797191680 00000100:00100000:3.0:1790736202.752422:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797191808 00000100:00100000:3.0:1790736202.752442:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797191808 00000100:00100000:3.0:1790736202.752467:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 41 00000100:00100000:3.0:1790736202.752474:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633819880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2355:x1877722797191680:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736202.752511:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633819880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2355:x1877722797191680:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 37us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736202.752518:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 41 00000100:00100000:3.0:1790736202.752531:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 42 00000100:00100000:3.0:1790736202.752537:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2355:x1877722797191808:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736202.752561:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2355:x1877722797191808:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 24us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736202.752567:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 42 00000100:00080000:3.0:1790736202.752752:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790736202.752755:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790736202.903669:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b30ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1877722816099840:0@lo:400:kworker.0 00000100:00100000:3.0:1790736202.903737:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736202.903802:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790736202.903808:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b30f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816099968:0@lo:400:kworker.0 00000100:00100000:3.0:1790736202.903836:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736202.903878:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816099840 00000100:00100000:3.0:1790736202.903886:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816099840 00000100:00100000:3.0:1790736202.903940:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790736202.903949:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877722816099840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736202.904000:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877722816099840:12345-0@lo:400:kworker.0 Request processed in 52us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736202.904022:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790736202.904048:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816099968 00000100:00100000:3.0:1790736202.904060:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816099968 00000100:00100000:3.0:1790736202.904088:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790736202.904112:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816099968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736202.904144:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816099968:12345-0@lo:400:kworker.0 Request processed in 50us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736202.904150:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1790736202.904168:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790736202.904200:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163b30f800 x1877722816099968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736202.904214:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b30f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816099968:0@lo:400:kworker.0 00000100:00100000:3.0:1790736202.904226:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b30ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1877722816099840:0@lo:400:kworker.0 00000100:00100000:1.0:1790736202.907237:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b30d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816099584:0@lo:400:kworker.0 00000100:00100000:1.0:1790736202.907311:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736202.907364:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b30ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1877722816100096:0@lo:400:kworker.0 00000100:00100000:1.0:1790736202.907392:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736202.907444:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790736202.907451:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b30c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877722816099712:0@lo:400:kworker.0 00000100:00100000:1.0:1790736202.907489:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736202.907512:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b30dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816100224:0@lo:400:kworker.0 00000100:00100000:1.0:1790736202.907534:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736202.907565:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816100096 00000100:00100000:1.0:1790736202.907572:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816100096 00000100:00100000:1.0:1790736202.907619:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816099712 00000100:00100000:1.0:1790736202.907622:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816099712 00000100:00100000:1.0:1790736202.907641:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790736202.907648:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877722816100096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736202.907698:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877722816100096:12345-0@lo:400:kworker.0 Request processed in 51us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736202.907705:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790736202.907721:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790736202.907727:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877722816099712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736202.907753:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877722816099712:12345-0@lo:400:kworker.0 Request processed in 27us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736202.907758:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790736202.907778:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816100224 00000100:00100000:1.0:1790736202.907782:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816100224 00000100:00100000:1.0:1790736202.907809:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790736202.907815:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816100224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736202.907844:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816100224:12345-0@lo:400:kworker.0 Request processed in 30us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736202.907849:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1790736202.907877:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790736202.907882:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790736202.907915:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b30c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877722816099712:0@lo:400:kworker.0 00010000:00080000:1.0:1790736202.907945:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163b30dc00 x1877722816100224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736202.907955:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b30dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816100224:0@lo:400:kworker.0 00000100:00100000:1.0:1790736202.907965:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b30ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1877722816100096:0@lo:400:kworker.0 00000100:00100000:0.0:1790736202.909064:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816099584 00000100:00100000:0.0:1790736202.909074:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816099584 00000100:00100000:0.0:1790736202.909137:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1790736202.909146:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606657850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+19:3306:x1877722816099584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736202.909203:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606657850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+19:3306:x1877722816099584:12345-0@lo:400:kworker.0 Request processed in 59us (1893us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736202.909209:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1790736202.911497:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b30d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816099584:0@lo:400:kworker.0 00000100:00100000:1.0:1790736203.413467:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790736203.413566:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b30ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816100352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790736203.413727:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736203.413798:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816100352 00000100:00100000:2.0:1790736203.413811:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816100352 00000100:00100000:2.0:1790736203.413874:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790736203.413885:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816100352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790736203.413943:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790736203.414023:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816100352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736203.414031:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1790736203.417014:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163b30ea00 x1877722816100352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736219 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736203.417054:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b30ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816100352:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790736203.541602:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736204.565601:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736205.591382:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736206.615986:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790736206.997362:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790736206.997383:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160312ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816100480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790736206.997449:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736206.997514:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816100480 00000100:00100000:2.0:1790736206.997522:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816100480 00000100:00080000:0.0:1790736206.997570:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790736206.997588:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790736206.997598:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160312e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816100480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790736206.997631:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790736206.997701:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160312e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816100480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736206.997709:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1790736206.997757:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94160312ce00 x1877722816100480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736222 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790736206.997776:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160312ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816100480:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790736207.641860:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790736207.875438:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736207.875550:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797191936 00000100:00100000:1.0:1790736207.875561:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797191936 00000100:00100000:1.0:1790736207.875616:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 224 00000100:00100000:1.0:1790736207.875627:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+13:2355:x1877722797191936:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1790736207.875709:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+13:2355:x1877722797191936:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 84us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736207.875717:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 224 00000100:00100000:3.0:1790736207.884360:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736207.884402:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736207.884432:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736207.884463:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736207.884498:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797192320 00000100:00100000:2.0:1790736207.884506:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797192064 00000100:00100000:3.0:1790736207.884509:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797192320 00000100:00100000:2.0:1790736207.884514:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797192064 00000100:00100000:2.0:1790736207.884574:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797192192 00000100:00100000:2.0:1790736207.884578:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797192192 00000100:00100000:0.0:1790736207.884640:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797192448 00000100:00100000:0.0:1790736207.884646:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797192448 00000100:00100000:1.0:1790736207.884673:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 76 00000100:00100000:1.0:1790736207.884687:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2355:x1877722797192064:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1790736207.884782:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2355:x1877722797192064:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 99us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736207.884808:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 76 00000100:00100000:3.0:1790736207.885765:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 45 00000100:00100000:3.0:1790736207.885776:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2356:x1877722797192320:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736207.885827:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2356:x1877722797192320:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 53us (1423us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736207.885834:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 45 00000100:00100000:2.0:1790736207.888128:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 77 00000100:00100000:2.0:1790736207.888144:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2355:x1877722797192192:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1790736207.888233:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2355:x1877722797192192:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 93us (3799us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736207.888241:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 77 00000100:00100000:0.0:1790736207.891380:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 46 00000100:00100000:0.0:1790736207.891396:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2355:x1877722797192448:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1790736207.891677:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2355:x1877722797192448:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 285us (7211us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736207.891685:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 46 00000100:00080000:1.0:1790736207.898315:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790736207.898353:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790736207.898358:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790736208.022286:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b30f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816100992:0@lo:400:kworker.0 00000100:00100000:3.0:1790736208.022360:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736208.022424:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790736208.022430:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b30c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1877722816100864:0@lo:400:kworker.0 00000100:00100000:3.0:1790736208.022466:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736208.022498:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816100992 00000100:00100000:3.0:1790736208.022507:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816100992 00000100:00100000:3.0:1790736208.022559:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790736208.022568:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816100992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736208.022618:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816100992:12345-0@lo:400:kworker.0 Request processed in 51us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736208.022625:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790736208.022646:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816100864 00000100:00100000:3.0:1790736208.022650:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816100864 00000100:00100000:3.0:1790736208.022677:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790736208.022684:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877722816100864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736208.022721:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877722816100864:12345-0@lo:400:kworker.0 Request processed in 38us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736208.022727:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1790736208.022744:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790736208.022748:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790736208.022782:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b30c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1877722816100864:0@lo:400:kworker.0 00010000:00080000:3.0:1790736208.022794:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163b30f480 x1877722816100992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736208.022804:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b30f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816100992:0@lo:400:kworker.0 00000100:00100000:0.0:1790736208.023235:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b30df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816100608:0@lo:400:kworker.0 00000100:00100000:0.0:1790736208.023274:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736208.023311:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b30fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1877722816101120:0@lo:400:kworker.0 00000100:00100000:0.0:1790736208.023333:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736208.023354:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1790736208.023360:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b30d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877722816100736:0@lo:400:kworker.0 00000100:00100000:0.0:1790736208.023389:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736208.023407:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b30ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816101248:0@lo:400:kworker.0 00000100:00100000:0.0:1790736208.023427:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736208.023455:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816101120 00000100:00100000:0.0:1790736208.023460:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816101120 00000100:00100000:0.0:1790736208.023492:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816100736 00000100:00100000:0.0:1790736208.023495:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816100736 00000100:00100000:0.0:1790736208.023513:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1790736208.023519:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160312ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877722816101120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736208.023564:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160312ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877722816101120:12345-0@lo:400:kworker.0 Request processed in 46us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736208.023570:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1790736208.023593:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1790736208.023598:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160312e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877722816100736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736208.023626:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160312e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877722816100736:12345-0@lo:400:kworker.0 Request processed in 27us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736208.023632:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1790736208.023651:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816101248 00000100:00100000:0.0:1790736208.023654:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816101248 00000100:00100000:0.0:1790736208.023678:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790736208.023684:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160312ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816101248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736208.023712:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160312ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816101248:12345-0@lo:400:kworker.0 Request processed in 28us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736208.023717:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1790736208.023735:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790736208.023738:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790736208.023757:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b30d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877722816100736:0@lo:400:kworker.0 00010000:00080000:0.0:1790736208.023767:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163b30ea00 x1877722816101248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790736208.023776:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b30ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816101248:0@lo:400:kworker.0 00000100:00100000:0.0:1790736208.023785:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b30fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1877722816101120:0@lo:400:kworker.0 00000100:00100000:3.0:1790736208.024784:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816100608 00000100:00100000:3.0:1790736208.024793:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816100608 00000100:00100000:3.0:1790736208.024847:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1790736208.024857:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606654050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+19:3306:x1877722816100608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736208.024921:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606654050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+19:3306:x1877722816100608:12345-0@lo:400:kworker.0 Request processed in 66us (1645us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736208.024935:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1790736208.025630:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b30df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816100608:0@lo:400:kworker.0 00000100:00100000:0.0:1790736208.534211:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b30f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816101376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790736208.534284:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736208.534393:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816101376 00000100:00100000:3.0:1790736208.534402:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816101376 00000100:00100000:3.0:1790736208.534453:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790736208.534462:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160312df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816101376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790736208.534497:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790736208.534550:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160312df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816101376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736208.534556:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1790736208.534594:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163b30f480 x1877722816101376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736224 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736208.534611:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b30f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816101376:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790736208.686982:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736209.696170:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736210.710336:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736211.740386:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790736212.117587:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790736212.117622:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160312d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816101504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790736212.117689:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736212.117760:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816101504 00000100:00100000:0.0:1790736212.117768:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816101504 00000100:00100000:0.0:1790736212.117821:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790736212.117829:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160312c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816101504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790736212.117863:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790736212.117906:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160312c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816101504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736212.117914:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1790736212.117945:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790736212.117974:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94160312d880 x1877722816101504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736228 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790736212.118173:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160312d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816101504:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790736212.757500:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736212.991745:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736212.991940:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736212.992040:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736212.992071:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736212.992120:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797192960 00000100:00100000:3.0:1790736212.992129:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797192960 00000100:00100000:3.0:1790736212.992269:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 14 00000100:00100000:3.0:1790736212.992279:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2352:x1877722797192960:12345-192.168.203.5@tcp:9:kworker.0 00000020:00000080:3.0:1790736212.992311:0:6697:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6aae200528fe62c2 00000100:00080000:3.0:1790736212.992320:0:6697:0:(import.c:65:import_set_state_nolock()) ffff941635cd9000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790736212.992359:0:6697:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1790736212.994444:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797192704 00000100:00100000:0.0:1790736212.994455:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797192704 00000100:00100000:0.0:1790736212.994495:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797192832 00000100:00100000:0.0:1790736212.994498:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797192832 00000100:00100000:0.0:1790736212.994519:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 81 00000100:00100000:3.0:1790736212.994520:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+2:2352:x1877722797192960:12345-192.168.203.5@tcp:9:kworker.0 Request processed in 2239us (2576us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736212.994527:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2354:x1877722797192704:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736212.994556:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 14 00000100:00100000:0.0:1790736212.994563:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2354:x1877722797192704:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 37us (2830us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736212.994568:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 81 00000100:00100000:0.0:1790736212.994578:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 82 00000100:00100000:3.0:1790736212.994583:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797192576 00000100:00100000:0.0:1790736212.994584:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2353:x1877722797192832:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736212.994586:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797192576 00000100:00100000:3.0:1790736212.994611:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 226 00000100:00100000:3.0:1790736212.994617:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606654450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+13:2353:x1877722797192576:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1790736212.994618:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2353:x1877722797192832:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 34us (2546us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736212.994624:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 82 00000100:00100000:3.0:1790736212.994642:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606654450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+13:2353:x1877722797192576:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 25us (2602us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736212.994649:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 226 00000100:00080000:3.0:1790736212.994675:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790736212.994679:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790736212.994690:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790736213.005557:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736213.005633:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797193088 00000100:00100000:2.0:1790736213.005642:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797193088 00000100:00100000:2.0:1790736213.005753:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 15 00000100:00100000:2.0:1790736213.005763:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160312d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2352:x1877722797193088:12345-192.168.203.5@tcp:9:kworker.0 00000020:00000080:2.0:1790736213.005792:0:6698:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6aae200528fe62c9 00000100:00080000:2.0:1790736213.005802:0:6698:0:(import.c:65:import_set_state_nolock()) ffff94162d362800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790736213.005849:0:6698:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1790736213.005902:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790736213.006314:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160312d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+2:2352:x1877722797193088:12345-192.168.203.5@tcp:9:kworker.0 Request processed in 551us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736213.006323:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 15 00000100:00080000:3.0:1790736213.007084:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790736213.141363:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816102016:0@lo:400:kworker.0 00000100:00100000:2.0:1790736213.141433:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736213.141500:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790736213.141507:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f241f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1877722816101888:0@lo:400:kworker.0 00000100:00100000:2.0:1790736213.141534:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736213.141576:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816102016 00000100:00100000:2.0:1790736213.141584:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816102016 00000100:00100000:2.0:1790736213.141626:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790736213.141635:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160838f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816102016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736213.141687:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160838f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816102016:12345-0@lo:400:kworker.0 Request processed in 53us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736213.141694:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1790736213.141733:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94162f240000 x1877722816102016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790736213.141746:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816102016:0@lo:400:kworker.0 00000100:00100000:0.0:1790736213.141837:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f242d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816101632:0@lo:400:kworker.0 00000100:00100000:0.0:1790736213.141871:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736213.141906:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1877722816102144:0@lo:400:kworker.0 00000100:00100000:0.0:1790736213.141941:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736213.141969:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1790736213.141974:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f242680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877722816101760:0@lo:400:kworker.0 00000100:00100000:0.0:1790736213.141995:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736213.142011:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816102272:0@lo:400:kworker.0 00000100:00100000:0.0:1790736213.142030:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736213.142058:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816101888 00000100:00100000:0.0:1790736213.142062:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816101888 00000100:00100000:0.0:1790736213.142120:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816102144 00000100:00100000:0.0:1790736213.142123:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816102144 00000100:00100000:0.0:1790736213.142137:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816101760 00000100:00100000:0.0:1790736213.142140:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816101760 00000100:00100000:0.0:1790736213.142151:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790736213.142157:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160838ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877722816101888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736213.142194:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160838ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877722816101888:12345-0@lo:400:kworker.0 Request processed in 37us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736213.142201:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790736213.142213:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790736213.142218:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160312f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877722816102144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736213.142257:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160312f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877722816102144:12345-0@lo:400:kworker.0 Request processed in 38us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736213.142263:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790736213.142274:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790736213.142279:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160312fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877722816101760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736213.142303:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160312fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877722816101760:12345-0@lo:400:kworker.0 Request processed in 24us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736213.142309:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790736213.142329:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816102272 00000100:00100000:0.0:1790736213.142333:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816102272 00000100:00100000:0.0:1790736213.142356:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790736213.142362:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160312c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816102272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736213.142388:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160312c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816102272:12345-0@lo:400:kworker.0 Request processed in 27us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736213.142395:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1790736213.142409:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790736213.142413:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790736213.142435:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f242680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877722816101760:0@lo:400:kworker.0 00010000:00080000:0.0:1790736213.142445:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94160838dc00 x1877722816102272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790736213.142453:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816102272:0@lo:400:kworker.0 00000100:00100000:0.0:1790736213.142461:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1877722816102144:0@lo:400:kworker.0 00000100:00100000:0.0:1790736213.142484:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f241f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1877722816101888:0@lo:400:kworker.0 00000100:00100000:2.0:1790736213.144067:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816101632 00000100:00100000:2.0:1790736213.144078:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816101632 00000100:00100000:2.0:1790736213.150021:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1790736213.150039:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606655050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+19:3306:x1877722816101632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736213.150147:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606655050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+19:3306:x1877722816101632:12345-0@lo:400:kworker.0 Request processed in 113us (8274us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736213.150155:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1790736213.150435:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f242d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816101632:0@lo:400:kworker.0 00000100:00100000:0.0:1790736213.653719:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b30c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816102400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790736213.653799:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736213.653985:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816102400 00000100:00100000:3.0:1790736213.653994:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816102400 00000100:00100000:3.0:1790736213.654043:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790736213.654053:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160312d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816102400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790736213.654088:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790736213.654305:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160312d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816102400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 253us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736213.654313:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1790736213.654397:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163b30c380 x1877722816102400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736213.654415:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b30c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816102400:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790736213.781267:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736214.805426:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790736215.812885:0:6725:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af 00000020:00000080:3.0:1790736215.812894:0:6725:0:(genops.c:885:class_export_put()) final put ffff941635cdc000/d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af 00000020:00000080:1.0:1790736215.814589:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff941635cdc000/d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af for lustre-OST0000 00000020:00000080:1.0:1790736215.814658:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff941635cd9000 for lustre-OST0000 00010000:00010000:3.0:1790736215.830268:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790736216.168617:0:11035:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:2.0:1790736216.776391:0:7658:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af 00000020:00000080:2.0:1790736216.776403:0:7658:0:(genops.c:885:class_export_put()) final put ffff94162d363000/d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af 00000020:00000080:0.0:1790736216.777217:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff94162d363000/d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af for lustre-OST0001 00000020:00000080:0.0:1790736216.777383:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94162d362800 for lustre-OST0001 00010000:00010000:1.0:1790736216.853336:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736217.237537:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790736217.237561:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160312d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816102528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790736217.237634:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736217.239256:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816102528 00000100:00100000:0.0:1790736217.239268:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816102528 00000100:00100000:0.0:1790736217.239346:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790736217.239355:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816102528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790736217.239393:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790736217.239473:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816102528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (1838us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736217.239480:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1790736217.239637:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94160312d500 x1877722816102528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736233 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790736217.239659:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160312d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816102528:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790736217.239769:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790736217.878472:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790736218.129403:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736218.129485:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736218.129515:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736218.129619:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797193344 00000100:00100000:2.0:1790736218.129628:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797193344 00000100:00100000:2.0:1790736218.129684:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797193472 00000100:00100000:2.0:1790736218.129687:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797193472 00000100:00100000:2.0:1790736218.129718:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 86 00000100:00100000:2.0:1790736218.129727:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160312c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2355:x1877722797193344:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1790736218.129815:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160312c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2355:x1877722797193344:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 88us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736218.129822:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 86 00000100:00100000:2.0:1790736218.129839:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 87 00000100:00100000:2.0:1790736218.129845:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160312ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2355:x1877722797193472:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1790736218.129868:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160312ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2355:x1877722797193472:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 24us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736218.129874:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 87 00000100:00080000:2.0:1790736218.130194:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790736218.130375:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797193216 00000100:00100000:2.0:1790736218.130383:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797193216 00000100:00100000:2.0:1790736218.130414:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 228 00000100:00100000:2.0:1790736218.130421:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606655c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+13:2355:x1877722797193216:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1790736218.130455:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606655c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+13:2355:x1877722797193216:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 34us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736218.130461:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 228 00000100:00100000:0.0:1790736218.261530:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160312d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816103040:0@lo:400:kworker.0 00000100:00100000:0.0:1790736218.261598:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736218.261668:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790736218.261674:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160312dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1877722816102912:0@lo:400:kworker.0 00000100:00100000:0.0:1790736218.261701:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736218.261734:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816103040 00000100:00100000:0.0:1790736218.261742:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816103040 00000100:00100000:0.0:1790736218.262060:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790736218.262070:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816103040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736218.262154:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816103040:12345-0@lo:400:kworker.0 Request processed in 85us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736218.262161:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790736218.262192:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816102912 00000100:00100000:0.0:1790736218.262196:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816102912 00000100:00100000:0.0:1790736218.262229:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790736218.262236:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877722816102912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736218.262268:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877722816102912:12345-0@lo:400:kworker.0 Request processed in 33us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736218.262274:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1790736218.262292:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790736218.262321:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160312dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1877722816102912:0@lo:400:kworker.0 00010000:00080000:0.0:1790736218.262334:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94160312d500 x1877722816103040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790736218.262344:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160312d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816103040:0@lo:400:kworker.0 00000100:00100000:2.0:1790736218.262436:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160312ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877722816102784:0@lo:400:kworker.0 00000100:00100000:2.0:1790736218.262469:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736218.262502:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f7cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816103296:0@lo:400:kworker.0 00000100:00100000:2.0:1790736218.262525:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736218.262552:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790736218.262557:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160312f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52e04a2b-4e01-44b7-985c-7db034e22389:3307:1877722816102656:0@lo:400:kworker.0 00000100:00100000:2.0:1790736218.262582:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736218.262616:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f7cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1877722816103168:0@lo:400:kworker.0 00000100:00100000:2.0:1790736218.262638:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736218.262661:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816102656 00000100:00100000:2.0:1790736218.262665:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816102656 00000100:00100000:2.0:1790736218.262694:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1790736218.262701:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606655850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+19:3307:x1877722816102656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736218.262737:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606655850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+19:3307:x1877722816102656:12345-0@lo:400:kworker.0 Request processed in 36us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736218.262743:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1790736218.263225:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160312f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52e04a2b-4e01-44b7-985c-7db034e22389:3307:1877722816102656:0@lo:400:kworker.0 00000100:00100000:0.0:1790736218.266030:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816102784 00000100:00100000:0.0:1790736218.266046:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816102784 00000100:00100000:2.0:1790736218.266261:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816103168 00000100:00100000:2.0:1790736218.266266:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816103168 00000100:00100000:0.0:1790736218.266376:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790736218.266386:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160838e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877722816102784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736218.266475:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160838e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877722816102784:12345-0@lo:400:kworker.0 Request processed in 91us (4004us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736218.266482:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790736218.266496:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1790736218.266502:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160838d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877722816103168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736218.266525:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160838d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877722816103168:12345-0@lo:400:kworker.0 Request processed in 24us (3886us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736218.266530:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1790736218.266577:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790736218.267006:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816103296 00000100:00100000:0.0:1790736218.267013:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816103296 00000100:00100000:0.0:1790736218.267146:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790736218.267155:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160838f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816103296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736218.267372:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160838f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816103296:12345-0@lo:400:kworker.0 Request processed in 218us (4844us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736218.267379:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790736218.267431:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f7cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1877722816103168:0@lo:400:kworker.0 00000100:00100000:0.0:1790736218.267444:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160312ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877722816102784:0@lo:400:kworker.0 00010000:00080000:0.0:1790736218.267456:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94162f7cc380 x1877722816103296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790736218.267467:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f7cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816103296:0@lo:400:kworker.0 00000100:00080000:1.0:1790736218.267799:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790736218.774928:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b30d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816103424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790736218.774995:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736218.775105:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816103424 00000100:00100000:2.0:1790736218.775114:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816103424 00000100:00100000:2.0:1790736218.775171:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790736218.775181:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816103424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790736218.775217:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790736218.775261:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816103424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736218.775268:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1790736218.775378:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163b30d500 x1877722816103424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736234 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736218.775396:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b30d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816103424:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790736218.903847:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736219.925286:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790736220.041995:0:11183:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeff44b0a0 20000000:00000080:0.0:1790736220.042024:0:11183:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff941633ec2400 uarg=0000000000000000 20000000:01000000:0.0:1790736220.043383:0:11183:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790736220.043394:0:11183:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790736220.043399:0:11183:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1790736220.048451:0:11184:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1790736220.049775:0:11183:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1790736220.059939:0:11183:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1790736220.062648:0:11183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff941633c61e00/0x6aae200528fe62d0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736220.062691:0:11183:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff941611931000/0x6aae200528fe6275 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526cde expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736220.062703:0:11183:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94162156e400/0x6aae200528fe6283 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe627c expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736220.062710:0:11183:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94162156e000/0x6aae200528fe6291 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe628a expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736220.062716:0:11183:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94162156f600/0x6aae200528fe629f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe6298 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736220.062724:0:11183:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94162f8c9400/0x6aae200528fe62b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d16 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736220.062742:0:11183:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff941633c61e00/0x6aae200528fe62d0 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736220.062821:0:11183:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94162f8c9400/0x6aae200528fe62b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0x92962417a526d16 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736220.062841:0:11183:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94162f8c9400/0x6aae200528fe62b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526d16 expref: 12 pid: 5838 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736220.062863:0:11183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b6c7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11183:1877722816103552:192.168.203.5@tcp:104: 00010000:00010000:1.0:1790736220.063039:0:11183:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94162156f600/0x6aae200528fe629f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6aae200528fe6298 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736220.063070:0:11183:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94162156f600/0x6aae200528fe629f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6aae200528fe6298 expref: 18 pid: 5837 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736220.063081:0:11183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b6c7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11183:1877722816103680:0@lo:104: 00000100:00100000:1.0:1790736220.063184:0:11183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790736220.063249:0:11183:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94162156e000/0x6aae200528fe6291 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6aae200528fe628a expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736220.063259:0:11183:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94162156e000/0x6aae200528fe6291 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6aae200528fe628a expref: 18 pid: 5836 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736220.063269:0:11183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b6c5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11183:1877722816103808:0@lo:104: 00000100:00100000:2.0:1790736220.063272:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816103680 00000100:00100000:2.0:1790736220.063286:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816103680 00000100:00100000:1.0:1790736220.063296:0:11183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790736220.063335:0:11183:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94162156e400/0x6aae200528fe6283 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6aae200528fe627c expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736220.063345:0:11183:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94162156e400/0x6aae200528fe6283 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6aae200528fe627c expref: 18 pid: 5836 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736220.063354:0:11183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b6c4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11183:1877722816103936:0@lo:104: 00000100:00100000:2.0:1790736220.063356:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816103808 00000100:00100000:2.0:1790736220.063361:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816103808 00000100:00100000:2.0:1790736220.063383:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790736220.063389:0:11183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736220.063398:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52e04a2b-4e01-44b7-985c-7db034e22389+4:11183:x1877722816103680:12345-0@lo:104: 00010000:00010000:1.0:1790736220.063412:0:11183:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff941611931000/0x6aae200528fe6275 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0x92962417a526cde expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736220.063414:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff94162156f800/0x6aae200528fe6298 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe629f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736220.063428:0:11183:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff941611931000/0x6aae200528fe6275 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526cde expref: 12 pid: 5836 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736220.063445:0:11183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b6c7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11183:1877722816104064:192.168.203.5@tcp:104: 00000100:00100000:3.0:1790736220.063524:0:5826:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1790736220.063534:0:5826:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:2.0:1790736220.063576:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790736220.063583:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52e04a2b-4e01-44b7-985c-7db034e22389+4:11183:x1877722816103680:12345-0@lo:104: Request processed in 190us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736220.063593:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790736220.063615:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816103936 00000100:00100000:2.0:1790736220.063619:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816103936 00000100:00100000:2.0:1790736220.063636:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790736220.063642:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52e04a2b-4e01-44b7-985c-7db034e22389+4:11183:x1877722816103808:12345-0@lo:104: 00010000:00010000:2.0:1790736220.063650:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff94162156f200/0x6aae200528fe628a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe6291 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736220.063691:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790736220.063697:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52e04a2b-4e01-44b7-985c-7db034e22389+4:11183:x1877722816103808:12345-0@lo:104: Request processed in 56us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736220.063704:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790736220.063718:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790736220.063725:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52e04a2b-4e01-44b7-985c-7db034e22389+3:11183:x1877722816103936:12345-0@lo:104: 00010000:00010000:2.0:1790736220.063733:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe627c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe6283 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736220.063797:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790736220.063806:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff94162156f800/0x6aae200528fe6298 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe629f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736220.063815:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162156f800 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:3.0:1790736220.063819:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff94162156f800/0x6aae200528fe6298 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6aae200528fe629f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736220.063829:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff94162156f800/0x6aae200528fe6298 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6aae200528fe629f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790736220.063836:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff94162156f800/0x6aae200528fe6298 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6aae200528fe629f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790736220.063841:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790736220.063874:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff94162156f800/0x6aae200528fe6298 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe629f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736220.063894:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790736220.063920:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff94162156f800/0x6aae200528fe6298 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe629f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736220.063925:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1790736220.063927:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff94162156f800/0x6aae200528fe6298 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe629f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736220.063934:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52e04a2b-4e01-44b7-985c-7db034e22389+3:11183:x1877722816103936:12345-0@lo:104: Request processed in 209us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736220.063944:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1790736220.063945:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790736220.063957:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff94162156f200/0x6aae200528fe628a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe6291 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736220.063962:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790736220.063964:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162156f200 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:3.0:1790736220.063970:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff94162156f200/0x6aae200528fe628a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6aae200528fe6291 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736220.063978:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff94162156f200/0x6aae200528fe628a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6aae200528fe6291 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790736220.063984:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff94162156f200/0x6aae200528fe628a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6aae200528fe6291 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790736220.063989:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790736220.064007:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff94162156f200/0x6aae200528fe628a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe6291 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736220.064013:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790736220.064029:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff94162156f200/0x6aae200528fe628a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe6291 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736220.064034:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff94162156f200/0x6aae200528fe628a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe6291 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736220.064044:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736220.064046:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736220.064048:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736220.064072:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b30c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52e04a2b-4e01-44b7-985c-7db034e22389:3309:1877722816104192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790736220.064141:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736220.064186:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b30d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816104320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790736220.064227:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736220.064262:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816104192 00000100:00100000:3.0:1790736220.064267:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816104192 00010000:00010000:3.0:1790736220.064292:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94162156f600/0x6aae200528fe629f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe6298 expref: 19 pid: 5837 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736220.064313:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816104320 00000100:00100000:3.0:1790736220.064317:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816104320 00010000:00010000:3.0:1790736220.064328:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94162156e000/0x6aae200528fe6291 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe628a expref: 20 pid: 5836 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736220.064345:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790736220.064352:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160557e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52e04a2b-4e01-44b7-985c-7db034e22389+20:3309:x1877722816104192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790736220.064367:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790736220.064373:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94162156f600/0x6aae200528fe629f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe6298 expref: 20 pid: 5837 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736220.064384:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94162156f600/0x6aae200528fe629f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6aae200528fe6298 expref: 20 pid: 5837 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736220.064405:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790736220.064443:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160557e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52e04a2b-4e01-44b7-985c-7db034e22389+20:3309:x1877722816104192:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736220.064450:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1790736220.064466:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736220.064474:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe627c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe6283 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736220.064490:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941600030800 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:2.0:1790736220.064494:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe627c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6aae200528fe6283 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736220.064502:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1790736220.064504:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe627c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6aae200528fe6283 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736220.064511:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52e04a2b-4e01-44b7-985c-7db034e22389+19:3306:x1877722816104320:12345-0@lo:103:ldlm_bl.0 10000000:00010000:2.0:1790736220.064518:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe627c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6aae200528fe6283 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736220.064522:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:01000000:2.0:1790736220.064525:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790736220.064529:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94162156e000/0x6aae200528fe6291 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe628a expref: 19 pid: 5836 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736220.064550:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94162156e000/0x6aae200528fe6291 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6aae200528fe628a expref: 19 pid: 5836 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736220.064552:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe627c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe6283 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736220.064565:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790736220.064567:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790736220.064578:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe627c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe6283 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736220.064586:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe627c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe6283 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736220.064595:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52e04a2b-4e01-44b7-985c-7db034e22389+19:3306:x1877722816104320:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (367us total) trans 0 rc 0/0 00010000:00010000:2.0:1790736220.064603:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736220.064604:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1790736220.064608:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736220.064612:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736220.064618:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736220.064621:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736220.064660:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b30d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816104320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790736220.064676:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790736220.064682:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816104448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790736220.064704:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736220.064740:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b30c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52e04a2b-4e01-44b7-985c-7db034e22389:3309:1877722816104192:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790736220.065237:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816104448 00000100:00100000:2.0:1790736220.065245:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816104448 00010000:00010000:2.0:1790736220.065269:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94162156e400/0x6aae200528fe6283 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe627c expref: 19 pid: 5836 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736220.066141:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790736220.066158:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52e04a2b-4e01-44b7-985c-7db034e22389+19:3306:x1877722816104448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790736220.066177:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790736220.066184:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94162156e400/0x6aae200528fe6283 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe627c expref: 19 pid: 5836 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736220.066198:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94162156e400/0x6aae200528fe6283 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6aae200528fe627c expref: 19 pid: 5836 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736220.066220:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790736220.066606:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816104448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790736220.066640:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52e04a2b-4e01-44b7-985c-7db034e22389+19:3306:x1877722816104448:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (1587us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736220.066650:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790736220.069005:0:11183:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162f219a80 going to sleep for 11 seconds 00010000:00010000:1.0:1790736220.069065:0:11183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94162156f600/0x6aae200528fe629f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6aae200528fe6298 expref: 18 pid: 5837 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736220.069088:0:11183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b6c7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11183:1877722816103680:0@lo:104: 00010000:00010000:1.0:1790736220.070399:0:11183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94162156e000/0x6aae200528fe6291 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6aae200528fe628a expref: 17 pid: 5836 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736220.070416:0:11183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b6c5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11183:1877722816103808:0@lo:104: 00010000:00010000:1.0:1790736220.070429:0:11183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94162156e400/0x6aae200528fe6283 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6aae200528fe627c expref: 16 pid: 5836 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736220.070437:0:11183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b6c4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11183:1877722816103936:0@lo:104: 00000100:00100000:1.0:1790736220.073172:0:11183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b6c7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11183:1877722816103552:192.168.203.5@tcp:104: 00000100:00100000:0.0:1790736220.081397:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736220.081594:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797193600 00000100:00100000:3.0:1790736220.081608:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797193600 00010000:00010000:3.0:1790736220.081665:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94162f8c9400/0x6aae200528fe62b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526d16 expref: 13 pid: 5838 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736220.081718:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 28 00000100:00100000:3.0:1790736220.081730:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:637df299-95a2-42b2-90c0-64260eee1701+13:2356:x1877722797193600:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790736220.081756:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790736220.081763:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94162f8c9400/0x6aae200528fe62b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526d16 expref: 13 pid: 5838 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736220.081779:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94162f8c9400/0x6aae200528fe62b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526d16 expref: 13 pid: 5838 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736220.081829:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94162f8c9400/0x6aae200528fe62b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526d16 expref: 13 pid: 5838 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736220.081853:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790736220.081951:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:637df299-95a2-42b2-90c0-64260eee1701+12:2356:x1877722797193600:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 222us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736220.081960:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 28 00000100:00100000:1.0:1790736220.082198:0:11183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b6c7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11183:1877722816104064:192.168.203.5@tcp:104: 00010000:00010000:1.0:1790736220.082254:0:11183:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff941633c61e00/0x6aae200528fe62d0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736220.084928:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736220.085263:0:8527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797193728 00000100:00100000:0.0:1790736220.085281:0:8527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797193728 00010000:00010000:0.0:1790736220.085334:0:8527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff941611931000/0x6aae200528fe6275 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526cde expref: 12 pid: 5836 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736220.085407:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 29 00000100:00100000:0.0:1790736220.085419:0:8527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160838dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:637df299-95a2-42b2-90c0-64260eee1701+12:2355:x1877722797193728:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790736220.085442:0:8527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790736220.085468:0:8527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff941611931000/0x6aae200528fe6275 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526cde expref: 12 pid: 5836 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736220.085484:0:8527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff941611931000/0x6aae200528fe6275 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526cde expref: 12 pid: 5836 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736220.085508:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941611931000/0x6aae200528fe6275 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526cde expref: 12 pid: 5836 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736220.085536:0:8527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff941633c61e00/0x6aae200528fe62d0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736220.085546:0:8527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941633c61e00/0x6aae200528fe62d0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736220.085570:0:8527:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff941633c61e00/0x6aae200528fe62d0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736220.085577:0:8527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff941633c61e00/0x6aae200528fe62d0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736220.085585:0:8527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff941633c61e00/0x6aae200528fe62d0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736220.085592:0:8527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff941633c61e00/0x6aae200528fe62d0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736220.085598:0:8527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c61e00 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:0.0:1790736220.085603:0:8527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff941633c61e00/0x6aae200528fe62d0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736220.085612:0:8527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff941633c61e00/0x6aae200528fe62d0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736220.085644:0:8527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff941633c61e00/0x6aae200528fe62d0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736220.085658:0:8527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790736220.085737:0:8527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160838dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:637df299-95a2-42b2-90c0-64260eee1701+11:2355:x1877722797193728:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 318us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736220.085746:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 29 00010000:00010000:1.0:1790736220.090417:0:11183:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff941633c61e00/0x6aae200528fe62d0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736220.090445:0:11183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff941633c61e00/0x6aae200528fe62d0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736220.090453:0:11183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941633c61e00/0x6aae200528fe62d0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736220.949368:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736221.443177:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736221.443512:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797193856 00000100:00100000:0.0:1790736221.443526:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797193856 00000100:00100000:0.0:1790736221.443660:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 230 00000100:00100000:0.0:1790736221.443673:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606654850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+11:5596:x1877722797193856:12345-192.168.203.5@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790736221.443696:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736221.443722:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941600030400/0x6aae200528fe62d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x92962417a526d40 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736221.443771:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941600030400/0x6aae200528fe62d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d40 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736221.443784:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941600030400/0x6aae200528fe62d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d40 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736221.443794:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941600030400, rc 0) 00000100:00100000:0.0:1790736221.443879:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606654850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+12:5596:x1877722797193856:12345-192.168.203.5@tcp:101:ll_cfg_requeue.0 Request processed in 201us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736221.443895:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 230 00000100:00100000:2.0:1790736221.448123:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736221.452432:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797193984 00000100:00100000:1.0:1790736221.452469:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797193984 00000100:00100000:1.0:1790736221.452564:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 231 00000100:00100000:1.0:1790736221.452575:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606655450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+12:5596:x1877722797193984:12345-192.168.203.5@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790736221.454224:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606655450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+12:5596:x1877722797193984:12345-192.168.203.5@tcp:501:ll_cfg_requeue.0 Request processed in 1639us (6129us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736221.454238:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 231 00000100:00100000:1.0:1790736221.460864:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736221.461013:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797194112 00000100:00100000:2.0:1790736221.461026:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797194112 00000100:00100000:2.0:1790736221.462353:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 232 00000100:00100000:2.0:1790736221.462372:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606656450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+12:5596:x1877722797194112:12345-192.168.203.5@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790736221.462684:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606656450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+12:5596:x1877722797194112:12345-192.168.203.5@tcp:503:ll_cfg_requeue.0 Request processed in 316us (1830us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736221.462694:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 232 00000100:00100000:1.0:1790736221.472899:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736221.474601:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797194240 00000100:00100000:2.0:1790736221.474633:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797194240 00000100:00100000:2.0:1790736221.474732:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 233 00000100:00100000:2.0:1790736221.474746:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606657450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+12:5596:x1877722797194240:12345-192.168.203.5@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790736221.474797:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736221.474825:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941611930000/0x6aae200528fe62de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x92962417a526d47 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736221.474866:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941611930000/0x6aae200528fe62de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d47 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736221.474890:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941611930000/0x6aae200528fe62de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d47 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736221.474899:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611930000, rc 0) 00000100:00100000:2.0:1790736221.474986:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606657450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+13:5596:x1877722797194240:12345-192.168.203.5@tcp:101:ll_cfg_requeue.0 Request processed in 244us (2101us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736221.474994:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 233 00000100:00100000:2.0:1790736221.477453:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736221.477723:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797194368 00000100:00100000:1.0:1790736221.477736:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797194368 00000100:00100000:1.0:1790736221.477806:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 234 00000100:00100000:1.0:1790736221.477818:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606656c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+13:5596:x1877722797194368:12345-192.168.203.5@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790736221.478232:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606656c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+13:5596:x1877722797194368:12345-192.168.203.5@tcp:501:ll_cfg_requeue.0 Request processed in 413us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736221.478241:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 234 00000100:00100000:2.0:1790736221.483358:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736221.484165:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797194496 00000100:00100000:1.0:1790736221.484183:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797194496 00000100:00100000:1.0:1790736221.484246:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 235 00000100:00100000:1.0:1790736221.489962:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94161094a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+13:5596:x1877722797194496:12345-192.168.203.5@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790736221.490343:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94161094a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+13:5596:x1877722797194496:12345-192.168.203.5@tcp:503:ll_cfg_requeue.0 Request processed in 6081us (6989us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736221.490357:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 235 10000000:01000000:3.0:1790736221.589344:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790736221.589357:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94162d364800 from 7 10000000:01000000:3.0:1790736221.589364:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790736221.589435:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c9c00/0x6aae200528fe62e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736221.589449:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff94162f8c9c00/0x6aae200528fe62e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736221.589462:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff94162f8c9c00/0x6aae200528fe62e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736221.589494:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b30c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816104576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790736221.589624:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736221.589724:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611cf5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790736221.589897:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816104576 00000100:00100000:1.0:1790736221.589907:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816104576 00000100:00100000:1.0:1790736221.589968:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1790736221.589979:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94161094bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+16:5841:x1877722816104576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790736221.590016:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736221.590034:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941633c60400/0x6aae200528fe62ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe62e5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736221.590074:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941633c60400/0x6aae200528fe62ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe62e5 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736221.590086:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941633c60400/0x6aae200528fe62ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe62e5 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736221.590138:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c60400, rc 0) 00000100:00100000:1.0:1790736221.590196:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94161094bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+17:5841:x1877722816104576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 218us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736221.590203:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1790736221.590429:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b30c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816104576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790736221.590449:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff94162f8c9c00/0x6aae200528fe62e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe62ec expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736221.590458:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff94162f8c9c00/0x6aae200528fe62e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe62ec expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736221.590538:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b30c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816104704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790736221.590569:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736221.590604:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611cf5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790736221.590669:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816104704 00000100:00100000:2.0:1790736221.590677:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816104704 00000100:00100000:2.0:1790736221.590719:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1790736221.590728:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941610948c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+17:5841:x1877722816104704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790736221.591057:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941610948c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+17:5841:x1877722816104704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 329us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736221.591065:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1790736221.592371:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b30c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816104704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790736221.592451:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b30c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816104832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790736221.592540:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736221.592602:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611cf5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790736221.593333:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816104832 00000100:00100000:0.0:1790736221.593346:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816104832 00000100:00100000:0.0:1790736221.593429:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1790736221.593439:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94161094b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+17:5841:x1877722816104832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790736221.594522:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94161094b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+17:5841:x1877722816104832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1078us (1975us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736221.594534:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1790736221.595046:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b30c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816104832:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790736221.602472:0:11218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1790736221.602765:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1790736221.602793:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790736221.602808:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c9c00/0x6aae200528fe62e5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe62ec expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736221.602824:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff94162f8c9c00/0x6aae200528fe62e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe62ec expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790736221.602836:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790736221.602839:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94162d353800 from 7 10000000:01000000:3.0:1790736221.602842:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790736221.602906:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c9200/0x6aae200528fe62f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736221.602914:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff94162f8c9200/0x6aae200528fe62f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736221.602928:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff94162f8c9200/0x6aae200528fe62f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736221.602979:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b30c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816104960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790736221.603073:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736221.603284:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611cf5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790736221.603784:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816104960 00000100:00100000:1.0:1790736221.603795:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816104960 00000100:00100000:1.0:1790736221.603878:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1790736221.603890:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94161094b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+17:5841:x1877722816104960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790736221.603910:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736221.603929:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941633c60200/0x6aae200528fe62fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe62f3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736221.603962:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941633c60200/0x6aae200528fe62fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe62f3 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736221.603992:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941633c60200/0x6aae200528fe62fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe62f3 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736221.604003:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c60200, rc 0) 00000100:00100000:1.0:1790736221.604068:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94161094b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+18:5841:x1877722816104960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736221.604076:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1790736221.604505:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b30c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816104960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790736221.604535:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff94162f8c9200/0x6aae200528fe62f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe62fa expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736221.604546:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff94162f8c9200/0x6aae200528fe62f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe62fa expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736221.604652:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f7cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816105088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790736221.604704:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736221.604834:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607ea1f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790736221.604908:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816105088 00000100:00100000:1.0:1790736221.604914:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816105088 00000100:00100000:2.0:1790736221.606512:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1790736221.606540:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94161094a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+18:5841:x1877722816105088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790736221.607739:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94161094a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+18:5841:x1877722816105088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1205us (3026us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736221.607766:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1790736221.611519:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f7cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816105088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790736221.611614:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f7cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816105216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790736221.611727:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736221.611786:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607ea1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790736221.611864:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816105216 00000100:00100000:2.0:1790736221.611883:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816105216 00000100:00100000:2.0:1790736221.611947:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1790736221.611958:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941610948050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+18:5841:x1877722816105216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790736221.612256:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941610948050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+18:5841:x1877722816105216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 299us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736221.612265:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1790736221.613297:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f7cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816105216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790736221.614888:0:11220:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1790736221.615320:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1790736221.615348:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790736221.615364:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c9200/0x6aae200528fe62f3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe62fa expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736221.615379:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff94162f8c9200/0x6aae200528fe62f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe62fa expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790736221.615392:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790736221.615396:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff941604c0d800 from 7 10000000:01000000:0.0:1790736221.615399:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790736221.615455:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe6301 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736221.615465:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe6301 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736221.615478:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe6301 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736221.615509:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f7ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816105344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790736221.615599:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736221.615660:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607ea1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790736221.618548:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816105344 00000100:00100000:2.0:1790736221.618570:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816105344 00000100:00100000:2.0:1790736221.618638:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1790736221.618649:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941610948450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+18:5841:x1877722816105344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790736221.618672:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736221.618694:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941611931a00/0x6aae200528fe6308 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe6301 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736221.618730:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941611931a00/0x6aae200528fe6308 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe6301 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736221.618743:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941611931a00/0x6aae200528fe6308 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe6301 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736221.618754:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611931a00, rc 0) 00000100:00100000:2.0:1790736221.618879:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941610948450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+19:5841:x1877722816105344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 222us (3270us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736221.618888:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1790736221.618962:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f7ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816105344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790736221.618988:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe6301 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6308 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736221.618999:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe6301 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe6308 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736221.619124:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b30df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816105472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790736221.619247:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736221.619295:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611cf5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790736221.619351:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816105472 00000100:00100000:0.0:1790736221.619357:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816105472 00000100:00100000:0.0:1790736221.619396:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1790736221.619405:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941610949050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+19:5841:x1877722816105472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790736221.620322:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941610949050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+19:5841:x1877722816105472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 913us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736221.620333:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1790736221.620436:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b30df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816105472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790736221.620506:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816105600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790736221.620559:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736221.620607:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611ca20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790736221.620808:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816105600 00000100:00100000:3.0:1790736221.620816:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816105600 00000100:00100000:3.0:1790736221.620859:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1790736221.620878:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941610949c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+19:5841:x1877722816105600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790736221.621142:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816105600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790736221.621287:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941610949c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+19:5841:x1877722816105600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 419us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736221.621296:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000040:00080000:0.0:1790736221.622421:0:11221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1790736221.622961:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1790736221.622989:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790736221.623003:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe6301 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6308 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736221.623017:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe6301 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6308 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736221.975321:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790736222.359380:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f7cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816105728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790736222.359452:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736222.359542:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816105728 00000100:00100000:0.0:1790736222.359551:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816105728 00000100:00100000:0.0:1790736222.359612:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790736222.359622:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160838d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816105728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790736222.359656:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790736222.359699:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160838d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816105728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736222.359706:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1790736222.359822:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790736222.359855:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94162f7cdc00 x1877722816105728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736238 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790736222.359882:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f7cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816105728:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790736223.001206:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736223.231804:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736223.231844:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736223.231882:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736223.231920:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797194880 00000100:00100000:3.0:1790736223.231930:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797194880 00000100:00100000:3.0:1790736223.231982:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797194752 00000100:00100000:3.0:1790736223.231986:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797194752 00000100:00100000:3.0:1790736223.232009:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 91 00000100:00100000:3.0:1790736223.232018:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2354:x1877722797194880:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736223.232121:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2354:x1877722797194880:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 103us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736223.232130:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 91 00000100:00100000:2.0:1790736223.232347:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797194624 00000100:00100000:2.0:1790736223.232352:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797194624 00000100:00100000:2.0:1790736223.232384:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 245 00000100:00100000:2.0:1790736223.232391:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941610949850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+13:2354:x1877722797194624:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1790736223.232420:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941610949850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+13:2354:x1877722797194624:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 30us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736223.232435:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 245 00000100:00080000:2.0:1790736223.232463:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790736223.232479:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 92 00000100:00100000:2.0:1790736223.232486:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2354:x1877722797194752:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1790736223.232514:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2354:x1877722797194752:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 29us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736223.232520:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 92 00000100:00100000:0.0:1790736223.382494:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f7ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1877722816106112:0@lo:400:kworker.0 00000100:00100000:0.0:1790736223.382563:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736223.382633:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790736223.382640:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f7cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877722816105984:0@lo:400:kworker.0 00000100:00100000:0.0:1790736223.382665:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736223.382681:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f7cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816106496:0@lo:400:kworker.0 00000100:00100000:0.0:1790736223.382706:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736223.382745:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816106112 00000100:00100000:0.0:1790736223.382752:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816106112 00000100:00100000:0.0:1790736223.382797:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816105984 00000100:00100000:0.0:1790736223.382801:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816105984 00000100:00100000:0.0:1790736223.382821:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790736223.382829:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877722816106112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736223.382890:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877722816106112:12345-0@lo:400:kworker.0 Request processed in 61us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736223.382897:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790736223.382912:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1790736223.382918:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877722816105984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736223.382945:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877722816105984:12345-0@lo:400:kworker.0 Request processed in 27us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736223.382950:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1790736223.382970:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816106496 00000100:00100000:0.0:1790736223.382973:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816106496 00000100:00100000:0.0:1790736223.382998:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790736223.383004:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816106496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736223.383035:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816106496:12345-0@lo:400:kworker.0 Request processed in 31us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736223.383059:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1790736223.383077:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790736223.383081:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790736223.383939:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f7ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816106240:0@lo:400:kworker.0 00000100:00100000:1.0:1790736223.383986:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736223.384020:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790736223.384026:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f7cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816105856:0@lo:400:kworker.0 00000100:00100000:1.0:1790736223.384057:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736223.384086:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f7cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1877722816106368:0@lo:400:kworker.0 00000100:00100000:1.0:1790736223.384147:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736223.384175:0:8632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816106240 00000100:00100000:1.0:1790736223.384181:0:8632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816106240 00000100:00100000:1.0:1790736223.384214:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790736223.384221:0:8632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816106240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736223.384265:0:8632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816106240:12345-0@lo:400:kworker.0 Request processed in 44us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736223.384271:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790736223.384290:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816105856 00000100:00100000:1.0:1790736223.384293:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816105856 00000100:00100000:1.0:1790736223.384316:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1790736223.384335:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941610948850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+19:3308:x1877722816105856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736223.384365:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941610948850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+19:3308:x1877722816105856:12345-0@lo:400:kworker.0 Request processed in 32us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736223.384371:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1790736223.384404:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816106368 00000100:00100000:1.0:1790736223.384408:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816106368 00000100:00100000:1.0:1790736223.384433:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1790736223.384441:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877722816106368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736223.384468:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877722816106368:12345-0@lo:400:kworker.0 Request processed in 29us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736223.384473:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:1.0:1790736223.384487:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790736223.384509:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f7cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816105856:0@lo:400:kworker.0 00000100:00100000:1.0:1790736223.384521:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f7cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1877722816106368:0@lo:400:kworker.0 00010000:00080000:1.0:1790736223.384531:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94162f7ce300 x1877722816106240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736223.384540:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f7ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816106240:0@lo:400:kworker.0 00000100:00100000:0.0:1790736223.384771:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f7cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877722816105984:0@lo:400:kworker.0 00010000:00080000:0.0:1790736223.384783:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94162f7cdf80 x1877722816106496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790736223.384792:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f7cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816106496:0@lo:400:kworker.0 00000100:00100000:0.0:1790736223.384801:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f7ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1877722816106112:0@lo:400:kworker.0 00000100:00100000:1.0:1790736223.894961:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b30d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816106624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790736223.895031:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736223.895261:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816106624 00000100:00100000:3.0:1790736223.895270:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816106624 00000100:00100000:3.0:1790736223.895325:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790736223.895335:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816106624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790736223.895372:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790736223.895429:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816106624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736223.895438:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1790736223.895911:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163b30d880 x1877722816106624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736239 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736223.895931:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b30d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816106624:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790736224.021302:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790736224.546157:0:11384:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg305-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1790736225.046212:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736226.069311:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736227.093378:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790736227.477518:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790736227.477549:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f7ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816106752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790736227.477650:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736227.479128:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816106752 00000100:00100000:2.0:1790736227.479194:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816106752 00000100:00100000:2.0:1790736227.479318:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790736227.479331:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816106752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790736227.479386:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790736227.479473:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816106752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (1823us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736227.479481:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1790736227.480499:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94162f7ce680 x1877722816106752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736243 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790736227.480535:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f7ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816106752:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790736227.481665:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790736228.118191:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736228.351419:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736228.351887:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736228.351929:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736228.351967:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797195264 00000100:00100000:3.0:1790736228.351980:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797195264 00000100:00100000:3.0:1790736228.352054:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797195136 00000100:00100000:3.0:1790736228.352058:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797195136 00000100:00100000:3.0:1790736228.352084:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 96 00000100:00100000:3.0:1790736228.352148:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2353:x1877722797195264:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736228.352259:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2353:x1877722797195264:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 114us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736228.352269:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 96 00000100:00100000:3.0:1790736228.352288:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 97 00000100:00100000:3.0:1790736228.352294:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2353:x1877722797195136:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736228.352322:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2353:x1877722797195136:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 28us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736228.352328:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 97 00000100:00080000:3.0:1790736228.352349:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790736228.352780:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797195008 00000100:00100000:1.0:1790736228.352788:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797195008 00000100:00100000:1.0:1790736228.352834:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 247 00000100:00100000:1.0:1790736228.352842:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941610949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+13:2353:x1877722797195008:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1790736228.352884:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941610949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+13:2353:x1877722797195008:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 43us (1480us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736228.352891:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 247 00000100:00100000:2.0:1790736228.518050:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f241f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816107264:0@lo:400:kworker.0 00000100:00100000:2.0:1790736228.518168:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736228.518250:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790736228.518256:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f240700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816106880:0@lo:400:kworker.0 00000100:00100000:2.0:1790736228.518293:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736228.518322:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f242680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1877722816107392:0@lo:400:kworker.0 00000100:00100000:2.0:1790736228.518350:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736228.518380:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f241500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877722816107008:0@lo:400:kworker.0 00000100:00100000:2.0:1790736228.518426:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736228.518593:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816107520:0@lo:400:kworker.0 00000100:00100000:2.0:1790736228.518618:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736228.518682:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790736228.518763:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f242d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1877722816107136:0@lo:400:kworker.0 00000100:00100000:2.0:1790736228.518787:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736228.519164:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816107392 00000100:00100000:1.0:1790736228.519178:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816107392 00000100:00100000:1.0:1790736228.519248:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816107008 00000100:00100000:1.0:1790736228.519252:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816107008 00000100:00100000:1.0:1790736228.519266:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816107136 00000100:00100000:1.0:1790736228.519269:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816107136 00000100:00100000:1.0:1790736228.519288:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790736228.519299:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877722816107392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736228.519392:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877722816107392:12345-0@lo:400:kworker.0 Request processed in 94us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736228.519401:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790736228.519425:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1790736228.519430:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877722816107008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736228.526215:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877722816107008:12345-0@lo:400:kworker.0 Request processed in 6778us (7780us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736228.526229:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1790736228.526277:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790736228.526292:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877722816107136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736228.526327:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877722816107136:12345-0@lo:400:kworker.0 Request processed in 43us (7539us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736228.526358:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790736228.526398:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816106880 00000100:00100000:1.0:1790736228.526410:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816106880 00000100:00100000:1.0:1790736228.528865:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1790736228.528894:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94161094a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+19:3308:x1877722816106880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736228.529015:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94161094a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+19:3308:x1877722816106880:12345-0@lo:400:kworker.0 Request processed in 136us (10719us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736228.529024:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1790736228.529239:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f242d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1877722816107136:0@lo:400:kworker.0 00000100:00100000:1.0:1790736228.529256:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f241500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877722816107008:0@lo:400:kworker.0 00000100:00100000:1.0:1790736228.529299:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f240700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816106880:0@lo:400:kworker.0 00000100:00100000:1.0:1790736228.529314:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f242680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1877722816107392:0@lo:400:kworker.0 00000100:00080000:1.0:1790736228.529360:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790736228.530911:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816107264 00000100:00100000:3.0:1790736228.530930:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816107264 00000100:00100000:3.0:1790736228.531038:0:8632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816107520 00000100:00100000:3.0:1790736228.531043:0:8632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816107520 00000100:00100000:3.0:1790736228.531086:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790736228.531114:0:8632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816107264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736228.531230:0:8632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816107264:12345-0@lo:400:kworker.0 Request processed in 134us (13061us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736228.531239:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790736228.531259:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790736228.531266:0:8632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816107520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736228.531303:0:8632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816107520:12345-0@lo:400:kworker.0 Request processed in 39us (12684us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736228.531310:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1790736228.531330:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1790736228.531367:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94162f241f80 x1877722816107264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736228.531399:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f241f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816107264:0@lo:400:kworker.0 00010000:00080000:3.0:1790736228.531442:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94162f240000 x1877722816107520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736228.531452:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816107520:0@lo:400:kworker.0 00000001:02000400:2.0:1790736228.973991:0:11485:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 22:43:47 (1790736227) === 00000100:00100000:1.0:1790736229.013900:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790736229.013932:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b30c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816107648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790736229.014029:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736229.014642:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816107648 00000100:00100000:3.0:1790736229.014653:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816107648 00000100:00100000:3.0:1790736229.014726:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790736229.014737:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816107648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790736229.014785:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790736229.014865:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816107648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736229.014873:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1790736229.015088:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163b30c700 x1877722816107648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736245 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736229.015128:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b30c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816107648:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790736229.141402:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790736229.242585:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736229.242645:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797195392 00000100:00100000:2.0:1790736229.242658:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797195392 00000100:00100000:2.0:1790736229.242733:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 14 00000100:00100000:2.0:1790736229.242746:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2355:x1877722797195392:12345-192.168.203.5@tcp:41:mkdir.0 00000004:00000024:2.0:1790736229.242806:0:5844:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790736229.242937:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2355:x1877722797195392:12345-192.168.203.5@tcp:41:mkdir.0 Request processed in 193us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736229.242946:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 14 00000100:00100000:2.0:1790736229.243001:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736229.243608:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797195520 00000100:00100000:2.0:1790736229.243616:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797195520 00000100:00100000:2.0:1790736229.243657:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 0 00000100:00100000:2.0:1790736229.243665:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f945944d-9086-46a2-a91c-8bc7b88e8918+6:9664:x1877722797195520:12345-192.168.203.5@tcp:700:mkdir.0 00000100:00100000:2.0:1790736229.243735:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f945944d-9086-46a2-a91c-8bc7b88e8918+6:9664:x1877722797195520:12345-192.168.203.5@tcp:700:mkdir.0 Request processed in 70us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736229.243742:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 0 00000100:00100000:2.0:1790736229.253081:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736229.254781:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797195776 00000100:00100000:1.0:1790736229.254801:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797195776 00000100:00100000:1.0:1790736229.254986:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 15 00000100:00100000:1.0:1790736229.254999:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+6:9664:x1877722797195776:12345-192.168.203.5@tcp:36:mkdir.0 00010000:00010000:1.0:1790736229.255117:0:8114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736229.255156:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe61f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526cc9 expref: 6 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.255178:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94160678a200) 00010000:00010000:1.0:1790736229.255193:0:8114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790736229.255613:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe630f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.255631:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe630f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.255643:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe630f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.264018:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61600/0x6aae200528fe6316 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.264043:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61600/0x6aae200528fe6316 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.264057:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61600/0x6aae200528fe6316 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790736229.265951:0:8114:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790736229.265970:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe630f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.265981:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe630f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.265989:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe630f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.266004:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c61800 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736229.266009:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe630f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.266017:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe630f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.266032:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff941603253900) 00010000:00010000:1.0:1790736229.266035:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736229.266040:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe630f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.266046:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe630f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790736229.266074:0:8114:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000692e627c reply state 00000000d4fc533a transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61600/0x6aae200528fe6316 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736229.266083:0:8114:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790736229.267462:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+7:9664:x1877722797195776:12345-192.168.203.5@tcp:36:mkdir.0 Request processed in 12458us (14387us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1790736229.267474:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 15 00010000:00010000:0.0:1790736229.271058:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61600/0x6aae200528fe6316 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.271083:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61600/0x6aae200528fe6316 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.271115:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61600/0x6aae200528fe6316 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.271123:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c61600 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736229.271129:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61600/0x6aae200528fe6316 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.271150:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61600/0x6aae200528fe6316 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.271176:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff941603253800) 00010000:00010000:0.0:1790736229.271179:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736229.271185:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61600/0x6aae200528fe6316 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.271192:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61600/0x6aae200528fe6316 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736229.282186:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736229.282995:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797195904 00000100:00100000:3.0:1790736229.283011:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797195904 00000100:00100000:3.0:1790736229.283395:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 16 00000100:00100000:3.0:1790736229.283408:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+6:9665:x1877722797195904:12345-192.168.203.5@tcp:101:chmod.0 00010000:00010000:3.0:1790736229.283436:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736229.283471:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9e00/0x6aae200528fe631d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526d4e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736229.283552:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe6324 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736229.283570:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe6324 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736229.283600:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe6324 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790736229.283643:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790736229.283648:0:5844:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790736229.287869:0:5844:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe6324 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736229.288010:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9e00/0x6aae200528fe631d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d4e expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736229.288034:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe6324 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d4e expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736229.288044:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94161505d900) 00010000:00010000:3.0:1790736229.288047:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790736229.288050:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c9400, rc 0) 00000100:00100000:3.0:1790736229.288281:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+7:9665:x1877722797195904:12345-192.168.203.5@tcp:101:chmod.0 Request processed in 4874us (6110us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736229.288292:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 16 00000100:00100000:0.0:1790736229.292600:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736229.292757:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797196160 00000100:00100000:1.0:1790736229.292774:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797196160 00000100:00100000:1.0:1790736229.292855:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 17 00000100:00100000:1.0:1790736229.292866:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+7:9665:x1877722797196160:12345-192.168.203.5@tcp:36:chmod.0 00010000:00010000:1.0:1790736229.292920:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736229.292950:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe6324 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d4e expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.292992:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94161505d900) 00010000:00010000:1.0:1790736229.293005:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790736229.293034:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe632b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.293047:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe632b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.293057:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe632b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790736229.293412:0:5845:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ff69b62d reply state 000000004325ba3c transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe632b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736229.293423:0:5845:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1790736229.293433:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1790736229.293533:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+8:9665:x1877722797196160:12345-192.168.203.5@tcp:36:chmod.0 Request processed in 669us (947us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1790736229.293541:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 17 00010000:00010000:3.0:1790736229.297201:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe632b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736229.297220:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe632b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736229.297228:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe632b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736229.297249:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c61800 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736229.297254:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe632b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736229.297262:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe632b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736229.297279:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff941603253900) 00010000:00010000:3.0:1790736229.297281:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790736229.297286:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe632b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736229.297293:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe632b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736229.339291:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736229.339403:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797196288 00000100:00100000:2.0:1790736229.339425:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797196288 00000100:00100000:2.0:1790736229.339502:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18 00000100:00100000:2.0:1790736229.339513:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+7:9666:x1877722797196288:12345-192.168.203.5@tcp:101:chown.0 00010000:00010000:2.0:1790736229.339546:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736229.339579:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe6332 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526d55 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736229.339672:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6339 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736229.339688:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6339 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736229.339704:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6339 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790736229.339749:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790736229.339754:0:5843:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790736229.339805:0:5843:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6339 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736229.339849:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe6332 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d55 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736229.339883:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6339 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d55 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736229.339894:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94160678a400) 00010000:00010000:2.0:1790736229.339897:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790736229.339902:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611930400, rc 0) 00000100:00100000:2.0:1790736229.339987:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+8:9666:x1877722797196288:12345-192.168.203.5@tcp:101:chown.0 Request processed in 475us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736229.339996:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18 00000100:00100000:3.0:1790736229.350790:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736229.350868:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797196416 00000100:00100000:1.0:1790736229.350897:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797196416 00000100:00100000:1.0:1790736229.350969:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 19 00000100:00100000:1.0:1790736229.350981:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+8:9666:x1877722797196416:12345-192.168.203.5@tcp:101:chown.0 00010000:00010000:1.0:1790736229.351008:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736229.351036:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6340 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526d5c expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.351146:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61000/0x6aae200528fe6347 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.351181:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61000/0x6aae200528fe6347 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.351195:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61000/0x6aae200528fe6347 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.351214:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe634e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.351221:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe634e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.351227:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe634e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.351339:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61200/0x6aae200528fe6355 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.351347:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61200/0x6aae200528fe6355 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.351355:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61200/0x6aae200528fe6355 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790736229.351391:0:8114:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790736229.351396:0:8114:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790736229.351422:0:8114:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61200/0x6aae200528fe6355 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.351436:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61000/0x6aae200528fe6347 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.351454:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61000/0x6aae200528fe6347 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.351461:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61000/0x6aae200528fe6347 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.351467:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c61000 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736229.351473:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61000/0x6aae200528fe6347 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.351481:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61000/0x6aae200528fe6347 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.351495:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94160678a400) 00010000:00010000:1.0:1790736229.351498:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736229.351503:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61000/0x6aae200528fe6347 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.351509:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61000/0x6aae200528fe6347 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.351521:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe634e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.351527:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe634e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.351533:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe634e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.351538:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c61c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736229.351548:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe634e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.351555:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe634e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.351564:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff941603253400) 00010000:00010000:1.0:1790736229.351566:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736229.351569:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe634e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.351575:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe634e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.351611:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6340 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d5c expref: 10 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.351624:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61200/0x6aae200528fe6355 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d5c expref: 9 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.351632:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff941603253a00) 00010000:00010000:1.0:1790736229.351634:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790736229.351637:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c61200, rc 0) 00000100:00100000:1.0:1790736229.351720:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+9:9666:x1877722797196416:12345-192.168.203.5@tcp:101:chown.0 Request processed in 741us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736229.351729:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 19 00000100:00100000:1.0:1790736229.357579:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736229.357639:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797196672 00000100:00100000:2.0:1790736229.357656:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797196672 00000100:00100000:2.0:1790736229.357754:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 20 00000100:00100000:2.0:1790736229.357766:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+9:9666:x1877722797196672:12345-192.168.203.5@tcp:36:chown.0 00010000:00010000:2.0:1790736229.357857:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790736229.358022:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61200/0x6aae200528fe6355 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d5c expref: 9 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736229.358046:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff941603253a00) 00010000:00010000:2.0:1790736229.358059:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790736229.358120:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe635c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736229.358137:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe635c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736229.358149:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe635c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790736229.420089:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:3.0:1790736229.420143:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1790736229.420234:0:5843:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001abc003a reply state 0000000072566e79 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe635c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736229.420274:0:5843:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1790736229.420294:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:1.0:1790736229.420430:0:5843:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1790736229.420454:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+7:9666:x1877722797196672:12345-192.168.203.5@tcp:36:chown.0 Request processed in 62684us (62879us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1790736229.420463:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 20 00010000:00010000:1.0:1790736229.420505:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe635c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.420514:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe635c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.420522:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe635c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.420528:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941611931c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736229.420533:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe635c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.420541:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe635c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.420560:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94160678ac00) 00010000:00010000:1.0:1790736229.420563:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790736229.420568:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe635c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.420573:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe635c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736229.445321:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736229.445462:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797196800 00000100:00100000:0.0:1790736229.445476:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797196800 00000100:00100000:0.0:1790736229.445550:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 21 00000100:00100000:0.0:1790736229.445562:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+6:9667:x1877722797196800:12345-192.168.203.5@tcp:101:touch.500 00010000:00010000:0.0:1790736229.445595:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736229.445625:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941600030600/0x6aae200528fe6363 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526d63 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790736229.447686:0:8114:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1982us 00010000:00010000:1.0:1790736229.475231:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe636a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.475258:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe636a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.475272:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe636a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.475292:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6371 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.475300:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6371 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.475306:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6371 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.475820:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61000/0x6aae200528fe6378 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.476283:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61000/0x6aae200528fe6378 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.476293:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61000/0x6aae200528fe6378 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790736229.476328:0:8114:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790736229.476333:0:8114:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790736229.476383:0:8114:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61000/0x6aae200528fe6378 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.476410:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe636a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.476418:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe636a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.476425:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe636a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.476433:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c61400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736229.476437:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe636a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.476445:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe636a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.476458:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94160678a400) 00010000:00010000:1.0:1790736229.476462:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736229.476467:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe636a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.476474:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe636a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.476489:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6371 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.476495:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6371 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.476501:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6371 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.476513:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c61c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736229.476516:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6371 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.476522:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6371 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.476530:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff941603253400) 00010000:00010000:1.0:1790736229.476533:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736229.476535:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6371 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.476541:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6371 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.476592:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941600030600/0x6aae200528fe6363 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d63 expref: 8 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.476609:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61000/0x6aae200528fe6378 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d63 expref: 7 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.476617:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff941603253f00) 00010000:00010000:1.0:1790736229.476619:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790736229.476622:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c61000, rc 0) 00000100:00100000:1.0:1790736229.476855:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+7:9667:x1877722797196800:12345-192.168.203.5@tcp:101:touch.500 Request processed in 31292us (31548us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736229.476865:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 21 00000100:00100000:3.0:1790736229.481060:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736229.481208:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797197056 00000100:00100000:0.0:1790736229.481220:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797197056 00000100:00100000:0.0:1790736229.481286:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 22 00000100:00100000:0.0:1790736229.481298:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+7:9667:x1877722797197056:12345-192.168.203.5@tcp:101:touch.500 00010000:00010000:0.0:1790736229.481329:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736229.481375:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941600030600/0x6aae200528fe637f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526d6a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.481795:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6386 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.481822:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6386 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.481836:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6386 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.481852:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe638d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.481860:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe638d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.481866:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe638d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790736229.484213:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1790736229.484567:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6394 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.484587:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6394 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.484599:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6394 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.484642:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6386 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.484651:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6386 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.484659:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6386 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.485600:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642173e00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736229.485611:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6386 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.485624:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6386 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.485641:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff941603253f00) 00010000:00010000:1.0:1790736229.485644:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736229.485649:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6386 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.485656:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6386 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790736229.485772:0:5844:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b4964483 reply state 000000009b69d38e transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe638d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736229.485783:0:5844:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790736229.485979:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941600030600/0x6aae200528fe637f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d6a expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.485998:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6394 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d6a expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.486006:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff941603253400) 00010000:00010000:1.0:1790736229.486009:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790736229.486012:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c61c00, rc 0) 00000100:00100000:1.0:1790736229.487535:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+10:9667:x1877722797197056:12345-192.168.203.5@tcp:101:touch.500 Request processed in 6224us (6473us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1790736229.487549:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 22 00000100:00100000:3.0:1790736229.494338:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00010000:00010000:2.0:1790736229.494682:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe638d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736229.494700:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe638d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736229.494708:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe638d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736229.494737:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642173c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736229.494743:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe638d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736229.494751:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe638d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736229.494769:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x5bdc1d92 (ffff941605242d00) 00010000:00010000:2.0:1790736229.494772:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790736229.494777:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe638d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736229.494784:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe638d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736229.495231:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797197312 00000100:00100000:1.0:1790736229.495245:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797197312 00000100:00100000:1.0:1790736229.495351:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 23 00000100:00100000:1.0:1790736229.495363:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+9:9667:x1877722797197312:12345-192.168.203.5@tcp:36:touch.500 00010000:00010000:1.0:1790736229.495444:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736229.495468:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6394 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d6a expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.495482:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff941603253400) 00010000:00010000:1.0:1790736229.495489:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790736229.495551:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe63a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.495568:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe63a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.495580:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe63a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790736229.495763:0:5845:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f2792b17 reply state 0000000062ef366d transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe63a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736229.495774:0:5845:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790736229.495972:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+10:9667:x1877722797197312:12345-192.168.203.5@tcp:36:touch.500 Request processed in 610us (1650us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1790736229.495981:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 23 00010000:00010000:2.0:1790736229.499061:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe63a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736229.499083:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe63a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736229.499091:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe63a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736229.499127:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c61400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736229.499133:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe63a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736229.499141:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe63a2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736229.499187:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff941603253b00) 00010000:00010000:2.0:1790736229.499190:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790736229.499197:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe63a2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736229.499203:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe63a2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736229.499849:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736229.499962:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797197440 00000100:00100000:2.0:1790736229.499977:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797197440 00000100:00100000:2.0:1790736229.500048:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 24 00000100:00100000:2.0:1790736229.500062:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+9:9667:x1877722797197440:12345-192.168.203.5@tcp:101:touch.500 00010000:00010000:2.0:1790736229.500111:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736229.500138:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611930600/0x6aae200528fe63a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526d71 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736229.500215:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611930600/0x6aae200528fe63a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d71 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736229.500231:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930600/0x6aae200528fe63a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d71 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736229.500254:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94160678a000) 00010000:00010000:2.0:1790736229.500257:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790736229.500260:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611930600, rc 0) 00000100:00100000:2.0:1790736229.500340:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+10:9667:x1877722797197440:12345-192.168.203.5@tcp:101:touch.500 Request processed in 281us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736229.500348:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 24 00000100:00100000:3.0:1790736229.504492:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736229.504854:0:8632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797197568 00000100:00100000:0.0:1790736229.504868:0:8632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797197568 00000100:00100000:0.0:1790736229.504933:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 16 00000100:00100000:0.0:1790736229.504943:0:8632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2352:x1877722797197568:12345-192.168.203.5@tcp:8:touch.500 00010000:00080000:0.0:1790736229.504985:0:8632:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from f945944d-9086-46a2-a91c-8bc7b88e8918@192.168.203.5@tcp t0 exp 0000000000000000 cur 301 last 0 00000020:00000080:0.0:1790736229.505023:0:8632:0:(genops.c:1384:class_connect()) connect: client f945944d-9086-46a2-a91c-8bc7b88e8918, cookie 0x6aae200528fe63b0 00002000:00100000:0.0:1790736229.505038:0:8632:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f945944d-9086-46a2-a91c-8bc7b88e8918/ffff94163c632000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790736229.505070:0:8632:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790736229.505773:0:8632:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790736229.505943:0:8632:0:(import.c:65:import_set_state_nolock()) ffff94163c633000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790736229.506088:0:8632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2352:x1877722797197568:12345-192.168.203.5@tcp:8:touch.500 Request processed in 1144us (1608us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736229.506128:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 16 00000100:00100000:0.0:1790736229.510514:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736229.511172:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797197696 00000100:00100000:3.0:1790736229.511187:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797197696 00000100:00100000:3.0:1790736229.511284:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 17 00000100:00100000:3.0:1790736229.511296:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+6:0:x1877722797197696:12345-192.168.203.5@tcp:2:touch.500 00000100:00080000:1.0:1790736229.511763:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1790736229.559803:0:6725:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f945944d-9086-46a2-a91c-8bc7b88e8918 00000001:00080000:2.0:1790736229.559843:0:6725:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:1.0:1790736229.560382:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+5:0:x1877722797197696:12345-192.168.203.5@tcp:2:touch.500 Request processed in 49079us (49875us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1790736229.560396:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 17 00000100:00100000:0.0:1790736229.563346:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736229.563439:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797197952 00000100:00100000:1.0:1790736229.563452:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797197952 00000100:00100000:1.0:1790736229.563518:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2 00000100:00100000:1.0:1790736229.563530:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+10:9667:x1877722797197952:12345-192.168.203.5@tcp:35:touch.500 00000100:00100000:1.0:1790736229.564022:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+11:9667:x1877722797197952:12345-192.168.203.5@tcp:35:touch.500 Request processed in 492us (689us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1790736229.564031:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2 00000100:00100000:2.0:1790736229.576045:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736229.576263:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797198080 00000100:00100000:0.0:1790736229.576277:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797198080 00000100:00100000:0.0:1790736229.576366:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 25 00000100:00100000:0.0:1790736229.576379:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+11:9668:x1877722797198080:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:0.0:1790736229.576413:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736229.576439:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe63b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526d78 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.576533:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe63be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.576552:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe63be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.576566:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe63be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790736229.576610:0:8114:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790736229.576615:0:8114:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790736229.576663:0:8114:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe63be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.576707:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe63b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d78 expref: 13 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.576746:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe63be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d78 expref: 12 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.576756:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff941603253f00) 00010000:00010000:0.0:1790736229.576759:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790736229.576763:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941642173600, rc 0) 00000100:00100000:0.0:1790736229.576857:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+12:9668:x1877722797198080:12345-192.168.203.5@tcp:101:rm.0 Request processed in 480us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736229.576864:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 25 00000100:00100000:1.0:1790736229.581360:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736229.581520:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797198336 00000100:00100000:2.0:1790736229.581534:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797198336 00000100:00100000:2.0:1790736229.581609:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 26 00000100:00100000:2.0:1790736229.581621:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+12:9668:x1877722797198336:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:2.0:1790736229.581653:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736229.581692:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931800/0x6aae200528fe63c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526d7f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790736229.581818:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790736229.582158:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931800/0x6aae200528fe63c5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d7f expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736229.582176:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94160678a400) 00010000:00010000:2.0:1790736229.582179:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790736229.582184:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931800/0x6aae200528fe63c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d7f expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736229.582201:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611931800, rc 0) 00000100:00100000:2.0:1790736229.582492:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+13:9668:x1877722797198336:12345-192.168.203.5@tcp:101:rm.0 Request processed in 871us (1160us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1790736229.582501:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 26 00000100:00100000:2.0:1790736229.598973:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736229.599313:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797198464 00000100:00100000:1.0:1790736229.599345:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797198464 00000100:00100000:1.0:1790736229.599455:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3 00000100:00100000:1.0:1790736229.599467:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+13:9668:x1877722797198464:12345-192.168.203.5@tcp:37:rm.0 00000100:00100000:2.0:1790736229.608393:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+13:9668:x1877722797198464:12345-192.168.203.5@tcp:37:rm.0 Request processed in 8912us (9419us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736229.608412:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3 00000100:00100000:2.0:1790736229.612233:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736229.612454:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797198720 00000100:00100000:3.0:1790736229.612469:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797198720 00000100:00100000:3.0:1790736229.612539:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 4 00000100:00100000:3.0:1790736229.612569:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416114edc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+13:9668:x1877722797198720:12345-192.168.203.5@tcp:35:rm.0 00000100:00100000:3.0:1790736229.612918:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416114edc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+14:9668:x1877722797198720:12345-192.168.203.5@tcp:35:rm.0 Request processed in 350us (699us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1790736229.612932:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 4 00000100:00100000:0.0:1790736229.618269:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736229.618592:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797198976 00000100:00100000:1.0:1790736229.618608:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797198976 00000100:00100000:1.0:1790736229.618693:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 27 00000100:00100000:1.0:1790736229.618705:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+14:9668:x1877722797198976:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:1.0:1790736229.618739:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736229.618766:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe63d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526d86 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.618917:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61e00/0x6aae200528fe63da lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.618936:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61e00/0x6aae200528fe63da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.618949:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61e00/0x6aae200528fe63da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790736229.618962:0:8114:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790736229.619168:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe63d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d86 expref: 17 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.619190:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61e00/0x6aae200528fe63da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d86 expref: 16 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.619200:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff941603253f00) 00010000:00010000:1.0:1790736229.619203:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790736229.619224:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c61e00, rc 0) 00000100:00100000:1.0:1790736229.619310:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+16:9668:x1877722797198976:12345-192.168.203.5@tcp:101:rm.0 Request processed in 606us (1054us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1790736229.619319:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 27 00000100:00100000:0.0:1790736229.630209:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736229.630619:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797199104 00000100:00100000:1.0:1790736229.630634:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797199104 00000100:00100000:1.0:1790736229.630711:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 28 00000100:00100000:1.0:1790736229.630722:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+16:9668:x1877722797199104:12345-192.168.203.5@tcp:41:rm.0 00000004:00000024:1.0:1790736229.630803:0:5845:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1790736229.631068:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+16:9668:x1877722797199104:12345-192.168.203.5@tcp:41:rm.0 Request processed in 347us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736229.631077:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 28 00000100:00100000:2.0:1790736229.635646:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736229.639364:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797199232 00000100:00100000:1.0:1790736229.639385:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797199232 00000100:00100000:1.0:1790736229.639592:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 29 00000100:00100000:1.0:1790736229.639605:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+16:9668:x1877722797199232:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:1.0:1790736229.639636:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736229.639675:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe63e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526d8d expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.639762:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe63ef lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.639782:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe63ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.639795:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe63ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.639853:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe63f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.639862:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe63f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.639869:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe63f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.640004:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61a00/0x6aae200528fe63fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.640013:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61a00/0x6aae200528fe63fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.640020:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61a00/0x6aae200528fe63fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790736229.640051:0:8114:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1790736229.640056:0:8114:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790736229.640079:0:8114:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61a00/0x6aae200528fe63fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.640122:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61a00/0x6aae200528fe63fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.640132:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe63ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.640140:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe63ef lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.640159:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe63ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.640166:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60a00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736229.640171:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe63ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.640180:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe63ef lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.640262:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff941603253f00) 00010000:00010000:1.0:1790736229.640267:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736229.640272:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe63ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.640280:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe63ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.640297:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe63f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.640303:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe63f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.640309:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe63f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.640314:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736229.640317:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe63f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.640335:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe63f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.640345:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x5bdc1d92 (ffff941603253400) 00010000:00010000:1.0:1790736229.640347:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736229.640350:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe63f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.640356:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe63f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.640396:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe63e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d8d expref: 18 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.640411:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61a00/0x6aae200528fe63fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d8d expref: 17 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.640418:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94160678a000) 00010000:00010000:1.0:1790736229.640420:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790736229.640434:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c61a00, rc 0) 00000100:00100000:1.0:1790736229.640532:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+17:9668:x1877722797199232:12345-192.168.203.5@tcp:101:rm.0 Request processed in 929us (4902us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736229.640540:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 29 00000100:00100000:2.0:1790736229.646182:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736229.647365:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797199488 00000100:00100000:0.0:1790736229.647382:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797199488 00000100:00100000:1.0:1790736229.648397:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 30 00000100:00100000:1.0:1790736229.648424:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+17:9668:x1877722797199488:12345-192.168.203.5@tcp:36:rm.0 00010000:00010000:1.0:1790736229.648513:0:8114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1790736229.648550:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61a00/0x6aae200528fe63fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d8d expref: 17 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.648604:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611930600/0x6aae200528fe63a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d71 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.648619:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94160678a000) 00010000:00010000:1.0:1790736229.648642:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe63be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d78 expref: 15 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.648654:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff941603253f00) 00010000:00010000:1.0:1790736229.648658:0:8114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790736229.649135:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6404 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.649153:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6404 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.649164:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6404 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.649182:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61200/0x6aae200528fe640b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.649258:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61200/0x6aae200528fe640b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.649269:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61200/0x6aae200528fe640b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.649463:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6412 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.649484:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6412 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.649491:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6412 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790736229.654508:0:8114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1790736229.654529:0:8114:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 301665434052ns, next at 302665429336ns, rc = 0 00010000:00010000:1.0:1790736229.654633:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61600/0x6aae200528fe6419 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.654656:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61600/0x6aae200528fe6419 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.654681:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61600/0x6aae200528fe6419 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.654855:0:8114:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61600/0x6aae200528fe6419 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.654864:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61600/0x6aae200528fe6419 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.654982:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61600/0x6aae200528fe6419 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.655085:0:8114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790736229.655147:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6412 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.655154:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6412 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.655179:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6412 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.655185:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c61800 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736229.655201:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6412 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.655210:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6412 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.655225:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff941603253b00) 00010000:00010000:1.0:1790736229.655229:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1790736229.655234:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6412 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.655240:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6412 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.655267:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6404 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.655274:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6404 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.655279:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6404 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.655285:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c61400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736229.655288:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6404 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.655304:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6404 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.655312:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff941603253f00) 00010000:00010000:1.0:1790736229.655315:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736229.655318:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6404 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.655324:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6404 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790736229.655336:0:8114:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000644bbb2a reply state 00000000710c3bf7 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61200/0x6aae200528fe640b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736229.655346:0:8114:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790736229.655482:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+16:9668:x1877722797199488:12345-192.168.203.5@tcp:36:rm.0 Request processed in 7066us (9309us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1790736229.655493:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 30 00010000:00010000:3.0:1790736229.662597:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790736229.662616:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61600/0x6aae200528fe6419 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736229.662630:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c61600 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:3.0:1790736229.662635:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61600/0x6aae200528fe6419 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736229.662647:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61600/0x6aae200528fe6419 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736229.662669:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff941603253b00) 00010000:00010000:3.0:1790736229.662672:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790736229.662676:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61600/0x6aae200528fe6419 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736229.662683:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61600/0x6aae200528fe6419 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736229.662723:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736229.662725:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736229.662726:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736229.663291:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61200/0x6aae200528fe640b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736229.663304:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61200/0x6aae200528fe640b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736229.663329:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61200/0x6aae200528fe640b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736229.663556:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736229.663740:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797199744 00000100:00100000:2.0:1790736229.663753:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797199744 00000100:00100000:2.0:1790736229.663830:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 5 00000100:00100000:2.0:1790736229.663841:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+16:9668:x1877722797199744:12345-192.168.203.5@tcp:35:rm.0 00000100:00100000:2.0:1790736229.664422:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+17:9668:x1877722797199744:12345-192.168.203.5@tcp:35:rm.0 Request processed in 352us (644us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1790736229.664441:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 5 00010000:00010000:3.0:1790736229.665319:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c61200 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736229.665330:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61200/0x6aae200528fe640b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736229.665343:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61200/0x6aae200528fe640b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736229.665363:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x5bdc1d92 (ffff941603253300) 00010000:00010000:3.0:1790736229.665366:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736229.665371:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61200/0x6aae200528fe640b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736229.665380:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61200/0x6aae200528fe640b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736229.670354:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736229.670580:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797200000 00000100:00100000:0.0:1790736229.670595:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797200000 00000100:00100000:0.0:1790736229.670678:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 31 00000100:00100000:0.0:1790736229.670701:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+16:9668:x1877722797200000:12345-192.168.203.5@tcp:36:rm.0 00010000:00010000:0.0:1790736229.670782:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1790736229.670827:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61e00/0x6aae200528fe63da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d86 expref: 16 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.670853:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61000/0x6aae200528fe6378 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d63 expref: 15 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.670865:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff941603253f00) 00010000:00010000:0.0:1790736229.670917:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6339 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d55 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.670927:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94160678a400) 00010000:00010000:0.0:1790736229.670934:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790736229.670971:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6420 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.670990:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6420 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.671003:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6420 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.671017:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6427 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.671023:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6427 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.671029:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6427 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.671648:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe642e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.671660:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe642e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.671667:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe642e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790736229.674055:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1790736229.674175:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe642e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.674189:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe642e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.674385:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe642e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.674392:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642172200 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736229.674398:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe642e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.674407:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe642e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.674492:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff941605242000) 00010000:00010000:0.0:1790736229.674497:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1790736229.674503:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe642e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.674511:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe642e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.674546:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6420 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.675052:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6420 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.675065:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6420 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.675070:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642173c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736229.675088:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6420 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.675298:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6420 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.675311:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff941605242300) 00010000:00010000:0.0:1790736229.675314:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736229.675318:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6420 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736229.675326:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6420 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790736229.675351:0:5843:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c51d2993 reply state 0000000097728942 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6427 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736229.675362:0:5843:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790736229.675621:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+15:9668:x1877722797200000:12345-192.168.203.5@tcp:36:rm.0 Request processed in 4927us (5283us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1790736229.675631:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 31 00010000:00010000:1.0:1790736229.678895:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6427 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.678915:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6427 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.678923:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6427 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.678928:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642173e00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736229.678934:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6427 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.678965:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6427 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.678984:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff941605242700) 00010000:00010000:1.0:1790736229.678987:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736229.678992:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6427 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736229.678997:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6427 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736230.165898:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736231.196250:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736232.213353:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1790736232.604937:0:6796:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 304615839799ns, next at 305615837432ns, rc = 0 00000100:00100000:0.0:1790736232.604984:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790736232.605004:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f7cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816107776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790736232.605068:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736232.605153:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816107776 00000100:00100000:0.0:1790736232.605161:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816107776 00000100:00100000:0.0:1790736232.605223:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790736232.605232:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816107776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790736232.605265:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790736232.605318:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816107776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736232.605325:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1790736232.605359:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790736232.605363:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94162f7cf100 x1877722816107776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736248 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790736232.605382:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f7cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816107776:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790736233.238730:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790736233.487598:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736233.488073:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736233.488190:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736233.488235:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736233.488272:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797200256 00000100:00100000:2.0:1790736233.488284:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797200256 00000100:00100000:2.0:1790736233.488355:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797200512 00000100:00100000:2.0:1790736233.488359:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797200512 00000100:00100000:2.0:1790736233.488388:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 101 00000100:00100000:2.0:1790736233.488400:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+14:2355:x1877722797200256:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1790736233.488583:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+14:2355:x1877722797200256:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 185us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736233.488592:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 101 00000100:00100000:2.0:1790736233.488612:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 102 00000100:00100000:2.0:1790736233.488618:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2355:x1877722797200512:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1790736233.488659:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2355:x1877722797200512:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 40us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736233.488763:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 102 00000100:00080000:2.0:1790736233.488865:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790736233.489408:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797200128 00000100:00100000:1.0:1790736233.489419:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797200128 00000100:00100000:1.0:1790736233.489462:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 249 00000100:00100000:1.0:1790736233.489471:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94161094b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+13:2355:x1877722797200128:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1790736233.489534:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94161094b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+13:2355:x1877722797200128:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 64us (1951us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736233.489542:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 249 00000100:00100000:0.0:1790736233.499862:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797200384 00000100:00100000:0.0:1790736233.499883:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797200384 00000100:00100000:0.0:1790736233.499977:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 57 00000100:00100000:0.0:1790736233.499989:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2355:x1877722797200384:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1790736233.500128:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2355:x1877722797200384:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 141us (12056us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736233.500137:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 57 00000100:00080000:2.0:1790736233.500296:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790736233.621611:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f7cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1877722816108160:0@lo:400:kworker.0 00000100:00100000:0.0:1790736233.621710:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736233.621808:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790736233.621815:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f7ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877722816108032:0@lo:400:kworker.0 00000100:00100000:0.0:1790736233.621868:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736233.621892:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160312d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816108544:0@lo:400:kworker.0 00000100:00100000:0.0:1790736233.621922:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736233.621968:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816108160 00000100:00100000:0.0:1790736233.621978:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816108160 00000100:00100000:0.0:1790736233.622045:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816108032 00000100:00100000:0.0:1790736233.622049:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816108032 00000100:00100000:0.0:1790736233.622074:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790736233.622083:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160312dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877722816108160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736233.622191:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160312dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877722816108160:12345-0@lo:400:kworker.0 Request processed in 108us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736233.622198:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790736233.622219:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790736233.622225:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163393fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877722816108032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736233.622270:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163393fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877722816108032:12345-0@lo:400:kworker.0 Request processed in 45us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736233.622276:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790736233.622317:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816108544 00000100:00100000:0.0:1790736233.622321:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816108544 00000100:00100000:0.0:1790736233.622350:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790736233.622356:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163393c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816108544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736233.622384:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163393c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816108544:12345-0@lo:400:kworker.0 Request processed in 29us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736233.622389:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1790736233.622405:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790736233.622410:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790736233.622452:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f7ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877722816108032:0@lo:400:kworker.0 00010000:00080000:0.0:1790736233.622466:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94160312d500 x1877722816108544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790736233.622476:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160312d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816108544:0@lo:400:kworker.0 00000100:00100000:0.0:1790736233.622485:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f7cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1877722816108160:0@lo:400:kworker.0 00000100:00100000:3.0:1790736233.622592:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160312ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816108288:0@lo:400:kworker.0 00000100:00100000:3.0:1790736233.622628:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736233.622660:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1790736233.622665:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f7cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816107904:0@lo:400:kworker.0 00000100:00100000:3.0:1790736233.622695:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736233.622723:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160312f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1877722816108416:0@lo:400:kworker.0 00000100:00100000:3.0:1790736233.622749:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736233.622778:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816107904 00000100:00100000:3.0:1790736233.622803:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816107904 00000100:00100000:3.0:1790736233.622835:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1790736233.622841:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416055c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+19:3308:x1877722816107904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736233.622882:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416055c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+19:3308:x1877722816107904:12345-0@lo:400:kworker.0 Request processed in 41us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736233.622887:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1790736233.622929:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f7cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816107904:0@lo:400:kworker.0 00000100:00100000:3.0:1790736233.622943:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816108416 00000100:00100000:3.0:1790736233.622946:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816108416 00000100:00100000:3.0:1790736233.622976:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1790736233.622981:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877722816108416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736233.623025:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877722816108416:12345-0@lo:400:kworker.0 Request processed in 43us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736233.623036:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:3.0:1790736233.623052:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790736233.623067:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160312f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1877722816108416:0@lo:400:kworker.0 00000100:00100000:0.0:1790736233.623590:0:8632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816108288 00000100:00100000:0.0:1790736233.623599:0:8632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816108288 00000100:00100000:0.0:1790736233.623671:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790736233.623689:0:8632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816108288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736233.623745:0:8632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816108288:12345-0@lo:400:kworker.0 Request processed in 58us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736233.623751:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1790736233.623814:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94160312ed80 x1877722816108288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736233.623827:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160312ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816108288:0@lo:400:kworker.0 00000100:00100000:1.0:1790736234.133448:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790736234.133478:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816108672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790736234.133575:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736234.133709:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816108672 00000100:00100000:3.0:1790736234.133720:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816108672 00000100:00100000:3.0:1790736234.133792:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790736234.133804:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816108672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790736234.133853:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790736234.133915:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816108672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736234.133923:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1790736234.133975:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163fae1180 x1877722816108672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736250 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736234.133996:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816108672:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1790736234.148538:0:11635:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1790736234.261227:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1790736234.732377:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1790736234.732412:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:0.0:1790736234.732425:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1790736234.732894:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816108800:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1790736234.732988:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736234.733084:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816108800 00000100:00100000:0.0:1790736234.733114:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816108800 00000100:00100000:0.0:1790736234.733193:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790736234.733203:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163393d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816108800:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1790736234.733235:0:6697:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1790736234.733280:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6abc7765, atime: 0x6abc7765, ctime: 0x6abc7765, blocks: 0x1 00010000:00010000:0.0:1790736234.733291:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074f72480/0x6aae200528fe6435 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736234.733311:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=306s v=(0 0) 00010000:00010000:0.0:1790736234.733316:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736234.733324:0:6697:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074f72480/0x6aae200528fe6435 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736234.733345:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074f72480/0x6aae200528fe6435 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736234.733357:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074f72480/0x6aae200528fe6435 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736234.733384:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074f72480/0x6aae200528fe6435 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736234.733405:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790736234.734406:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163393d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1877722816108800:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1200us (1414us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1790736234.734417:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:0.0:1790736234.734495:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94162f240000/2, rc 0, transno 4294967300 00000100:00100000:0.0:1790736234.734504:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816108800:0@lo:6:osp-syn-0-0.0 00000100:00080000:3.0:1790736234.735176:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790736234.735192:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790736234.735204:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074f72480/0x6aae200528fe6435 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736234.735218:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642173200 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:3.0:1790736234.735223:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074f72480/0x6aae200528fe6435 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736234.735235:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074f72480/0x6aae200528fe6435 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736234.735264:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074f72480/0x6aae200528fe6435 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736234.735273:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074f72480/0x6aae200528fe6435 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736234.735308:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736234.735310:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736234.735312:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736235.288030:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790736235.612066:0:11687:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdf1b69920 20000000:00000080:0.0:1790736235.612179:0:11687:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff941635ced000 uarg=0000000000000000 20000000:01000000:0.0:1790736235.612231:0:11687:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1790736235.612240:0:11687:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1790736235.612246:0:11687:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1790736235.613332:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1790736235.613502:0:11687:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1790736235.620539:0:11687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1790736235.620640:0:11687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1790736235.620707:0:11687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1790736235.620732:0:11687:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1790736235.620760:0:11687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff941642173000/0x6aae200528fe643c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736235.620802:0:11687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff941600030400/0x6aae200528fe62d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d40 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736235.620814:0:11687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff941611930000/0x6aae200528fe62de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d47 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736235.620848:0:11687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff941633c60400/0x6aae200528fe62ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe62e5 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736235.620854:0:11687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff941633c60200/0x6aae200528fe62fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe62f3 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736235.620861:0:11687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff941611931a00/0x6aae200528fe6308 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe6301 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736235.620870:0:11687:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff941642173000/0x6aae200528fe643c lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736235.620932:0:11687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff941611931a00/0x6aae200528fe6308 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6aae200528fe6301 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736235.620956:0:11687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff941611931a00/0x6aae200528fe6308 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6aae200528fe6301 expref: 18 pid: 5836 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736235.620977:0:11687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163393d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11687:1877722816108928:0@lo:104: 00000100:00100000:0.0:1790736235.621074:0:11687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790736235.621212:0:11687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff941633c60200/0x6aae200528fe62fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6aae200528fe62f3 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736235.621221:0:11687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff941633c60200/0x6aae200528fe62fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6aae200528fe62f3 expref: 18 pid: 5838 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736235.621231:0:11687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163393ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11687:1877722816109056:0@lo:104: 00000100:00100000:0.0:1790736235.621255:0:11687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790736235.621276:0:11687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff941633c60400/0x6aae200528fe62ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6aae200528fe62e5 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736235.621293:0:11687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff941633c60400/0x6aae200528fe62ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6aae200528fe62e5 expref: 18 pid: 5838 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736235.621301:0:11687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163393ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11687:1877722816109184:0@lo:104: 00000100:00100000:0.0:1790736235.621329:0:11687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736235.621379:0:5826:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1790736235.621395:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816108928 00000100:00100000:0.0:1790736235.621404:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816108928 00000100:00100000:0.0:1790736235.621452:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816109056 00000100:00100000:0.0:1790736235.621455:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816109056 00000100:00100000:0.0:1790736235.621463:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816109184 00000100:00100000:0.0:1790736235.621465:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816109184 00000100:00100000:0.0:1790736235.621477:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790736235.621487:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163393c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:52e04a2b-4e01-44b7-985c-7db034e22389+5:11687:x1877722816108928:12345-0@lo:104: 00010000:00010000:0.0:1790736235.621503:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe6301 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe6308 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736235.621558:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790736235.621564:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163393c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:52e04a2b-4e01-44b7-985c-7db034e22389+5:11687:x1877722816108928:12345-0@lo:104: Request processed in 78us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736235.621571:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790736235.621591:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790736235.621597:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163393f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:52e04a2b-4e01-44b7-985c-7db034e22389+4:11687:x1877722816109056:12345-0@lo:104: 00010000:00010000:0.0:1790736235.621606:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff94162f8c9200/0x6aae200528fe62f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe62fa expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736235.621638:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790736235.621650:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163393f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:52e04a2b-4e01-44b7-985c-7db034e22389+4:11687:x1877722816109056:12345-0@lo:104: Request processed in 53us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736235.621656:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790736235.621668:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790736235.621673:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162fa86850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:52e04a2b-4e01-44b7-985c-7db034e22389+3:11687:x1877722816109184:12345-0@lo:104: 00010000:00010000:0.0:1790736235.621681:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff94162f8c9c00/0x6aae200528fe62e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe62ec expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736235.621714:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1790736235.621719:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162fa86850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:52e04a2b-4e01-44b7-985c-7db034e22389+3:11687:x1877722816109184:12345-0@lo:104: Request processed in 46us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736235.621724:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1790736235.622006:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790736235.622015:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe6301 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe6308 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736235.622023:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941600030800 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:1.0:1790736235.622028:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe6301 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6aae200528fe6308 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736235.622038:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe6301 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6aae200528fe6308 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790736235.622047:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe6301 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6aae200528fe6308 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790736235.622054:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790736235.622123:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe6301 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe6308 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736235.622130:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790736235.622156:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe6301 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe6308 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736235.622164:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff941600030800/0x6aae200528fe6301 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe6308 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736235.622182:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790736235.622194:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff94162f8c9200/0x6aae200528fe62f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe62fa expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736235.622200:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c9200 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:1.0:1790736235.622203:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff94162f8c9200/0x6aae200528fe62f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6aae200528fe62fa expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736235.622210:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff94162f8c9200/0x6aae200528fe62f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6aae200528fe62fa expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790736235.622216:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff94162f8c9200/0x6aae200528fe62f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6aae200528fe62fa expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790736235.622221:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790736235.622235:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff94162f8c9200/0x6aae200528fe62f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe62fa expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736235.622241:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790736235.622258:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff94162f8c9200/0x6aae200528fe62f3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe62fa expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736235.622266:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff94162f8c9200/0x6aae200528fe62f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe62fa expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736235.622278:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790736235.622281:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff94162f8c9c00/0x6aae200528fe62e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe62ec expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736235.622287:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c9c00 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:1.0:1790736235.622291:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff94162f8c9c00/0x6aae200528fe62e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6aae200528fe62ec expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736235.622310:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff94162f8c9c00/0x6aae200528fe62e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6aae200528fe62ec expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790736235.622316:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff94162f8c9c00/0x6aae200528fe62e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6aae200528fe62ec expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790736235.622321:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790736235.622334:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff94162f8c9c00/0x6aae200528fe62e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe62ec expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736235.622341:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790736235.622347:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff94162f8c9c00/0x6aae200528fe62e5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe62ec expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736235.622354:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff94162f8c9c00/0x6aae200528fe62e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe62ec expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736235.622372:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736235.622374:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736235.622376:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736235.622395:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f241f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52e04a2b-4e01-44b7-985c-7db034e22389:3309:1877722816109312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790736235.622436:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736235.622487:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f242680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816109440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790736235.622511:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736235.622530:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790736235.622535:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f240700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816109568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790736235.622558:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736235.622591:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816109312 00000100:00100000:1.0:1790736235.622605:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816109312 00010000:00010000:1.0:1790736235.622703:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff941611931a00/0x6aae200528fe6308 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe6301 expref: 19 pid: 5836 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736235.622729:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816109440 00000100:00100000:1.0:1790736235.622733:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816109440 00010000:00010000:1.0:1790736235.622747:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff941633c60200/0x6aae200528fe62fa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe62f3 expref: 20 pid: 5838 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736235.622757:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816109568 00000100:00100000:1.0:1790736235.622760:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816109568 00010000:00010000:1.0:1790736235.622779:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff941633c60400/0x6aae200528fe62ec lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe62e5 expref: 21 pid: 5838 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736235.622792:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790736235.622798:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f241500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52e04a2b-4e01-44b7-985c-7db034e22389+21:3309:x1877722816109312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790736235.622812:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736235.622817:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff941611931a00/0x6aae200528fe6308 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe6301 expref: 21 pid: 5836 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736235.622827:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff941611931a00/0x6aae200528fe6308 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6aae200528fe6301 expref: 21 pid: 5836 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736235.622846:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790736235.622878:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f241500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52e04a2b-4e01-44b7-985c-7db034e22389+21:3309:x1877722816109312:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736235.622885:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790736235.622903:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790736235.622909:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f242d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52e04a2b-4e01-44b7-985c-7db034e22389+20:3306:x1877722816109440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790736235.622917:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736235.622928:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff941633c60200/0x6aae200528fe62fa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe62f3 expref: 20 pid: 5838 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736235.622936:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff941633c60200/0x6aae200528fe62fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6aae200528fe62f3 expref: 20 pid: 5838 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736235.622946:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790736235.622974:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f242d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52e04a2b-4e01-44b7-985c-7db034e22389+20:3306:x1877722816109440:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736235.622980:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790736235.622993:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790736235.622999:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160557c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52e04a2b-4e01-44b7-985c-7db034e22389+19:3306:x1877722816109568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790736235.623007:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736235.623012:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff941633c60400/0x6aae200528fe62ec lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe62e5 expref: 19 pid: 5838 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736235.623020:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff941633c60400/0x6aae200528fe62ec lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6aae200528fe62e5 expref: 19 pid: 5838 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736235.623029:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790736235.623050:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160557c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52e04a2b-4e01-44b7-985c-7db034e22389+19:3306:x1877722816109568:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736235.623056:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790736235.623157:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f241f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52e04a2b-4e01-44b7-985c-7db034e22389:3309:1877722816109312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790736235.623181:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f240700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816109568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790736235.623188:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f242680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816109440:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790736235.623230:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736235.623796:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736235.623943:0:11687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff941611930000/0x6aae200528fe62de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0x92962417a526d47 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736235.623962:0:11687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff941611930000/0x6aae200528fe62de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526d47 expref: 12 pid: 5837 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736235.623979:0:11687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163393c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11687:1877722816109696:192.168.203.5@tcp:104: 00010000:00010000:0.0:1790736235.624070:0:11687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff941600030400/0x6aae200528fe62d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0x92962417a526d40 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736235.624080:0:11687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff941600030400/0x6aae200528fe62d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526d40 expref: 12 pid: 5836 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736235.624089:0:11687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163393f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11687:1877722816109824:192.168.203.5@tcp:104: 00000100:00100000:0.0:1790736235.624144:0:11687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416338f7480 going to sleep for 11 seconds 00010000:00010000:0.0:1790736235.624166:0:11687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941611931a00/0x6aae200528fe6308 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6aae200528fe6301 expref: 18 pid: 5836 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736235.624191:0:11687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163393d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11687:1877722816108928:0@lo:104: 00010000:00010000:0.0:1790736235.624219:0:11687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941633c60200/0x6aae200528fe62fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6aae200528fe62f3 expref: 17 pid: 5838 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736235.624229:0:11687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163393ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11687:1877722816109056:0@lo:104: 00010000:00010000:0.0:1790736235.624239:0:11687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941633c60400/0x6aae200528fe62ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6aae200528fe62e5 expref: 16 pid: 5838 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736235.624247:0:11687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163393ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11687:1877722816109184:0@lo:104: 00000100:00100000:0.0:1790736235.645512:0:11687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163393c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11687:1877722816109696:192.168.203.5@tcp:104: 00000100:00100000:0.0:1790736235.645531:0:11687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163393f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11687:1877722816109824:192.168.203.5@tcp:104: 00010000:00010000:0.0:1790736235.645587:0:11687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff941642173000/0x6aae200528fe643c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736235.648856:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736235.649056:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797200640 00000100:00100000:1.0:1790736235.649071:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797200640 00010000:00010000:1.0:1790736235.649178:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff941611930000/0x6aae200528fe62de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526d47 expref: 13 pid: 5837 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736235.649232:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 33 00000100:00100000:1.0:1790736235.649243:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:637df299-95a2-42b2-90c0-64260eee1701+13:2354:x1877722797200640:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790736235.649263:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736235.649269:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff941611930000/0x6aae200528fe62de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526d47 expref: 13 pid: 5837 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736235.649284:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff941611930000/0x6aae200528fe62de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526d47 expref: 13 pid: 5837 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736235.649307:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941611930000/0x6aae200528fe62de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526d47 expref: 13 pid: 5837 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736235.649328:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790736235.649397:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:637df299-95a2-42b2-90c0-64260eee1701+12:2354:x1877722797200640:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 155us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736235.649405:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 33 00000100:00100000:3.0:1790736235.649737:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736235.652186:0:8527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797200768 00000100:00100000:1.0:1790736235.652207:0:8527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797200768 00010000:00010000:1.0:1790736235.652267:0:8527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff941600030400/0x6aae200528fe62d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526d40 expref: 12 pid: 5836 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736235.652324:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 34 00000100:00100000:1.0:1790736235.652335:0:8527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162edc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:637df299-95a2-42b2-90c0-64260eee1701+12:2354:x1877722797200768:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790736235.652356:0:8527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736235.652380:0:8527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff941600030400/0x6aae200528fe62d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526d40 expref: 12 pid: 5836 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736235.652395:0:8527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff941600030400/0x6aae200528fe62d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526d40 expref: 12 pid: 5836 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736235.652418:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941600030400/0x6aae200528fe62d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526d40 expref: 12 pid: 5836 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736235.652441:0:8527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff941642173000/0x6aae200528fe643c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736235.652451:0:8527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941642173000/0x6aae200528fe643c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736235.652473:0:8527:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff941642173000/0x6aae200528fe643c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736235.652481:0:8527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff941642173000/0x6aae200528fe643c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736235.652490:0:8527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff941642173000/0x6aae200528fe643c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736235.652499:0:8527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff941642173000/0x6aae200528fe643c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736235.652506:0:8527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642173000 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:1.0:1790736235.652511:0:8527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff941642173000/0x6aae200528fe643c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736235.652521:0:8527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff941642173000/0x6aae200528fe643c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736235.652540:0:8527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff941642173000/0x6aae200528fe643c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736235.652553:0:8527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790736235.652627:0:8527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162edc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:637df299-95a2-42b2-90c0-64260eee1701+11:2354:x1877722797200768:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 293us (2891us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736235.652636:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 34 00010000:00010000:0.0:1790736235.653005:0:11687:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff941642173000/0x6aae200528fe643c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736235.653017:0:11687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff941642173000/0x6aae200528fe643c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736235.653024:0:11687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941642173000/0x6aae200528fe643c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736236.310685:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790736237.077355:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790736237.077362:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94162d364800 from 7 10000000:01000000:2.0:1790736237.077367:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790736237.077417:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff941611930600/0x6aae200528fe6443 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736237.077429:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff941611930600/0x6aae200528fe6443 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736237.077439:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff941611930600/0x6aae200528fe6443 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736237.077465:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b780a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816109952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790736237.077788:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736237.077901:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816109952 00000100:00100000:2.0:1790736237.077913:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941605768900 going to sleep for 11 seconds 00000100:00100000:1.0:1790736237.077919:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816109952 00000100:00100000:1.0:1790736237.078012:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1790736237.078025:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416055c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+16:5841:x1877722816109952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790736237.078046:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736237.078069:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941633c61200/0x6aae200528fe644a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe6443 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736237.078149:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941633c61200/0x6aae200528fe644a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe6443 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736237.078163:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941633c61200/0x6aae200528fe644a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe6443 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736237.078174:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c61200, rc 0) 00000100:00100000:1.0:1790736237.078265:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416055c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+17:5841:x1877722816109952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 243us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736237.078273:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1790736237.078565:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b780a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816109952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790736237.078589:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff941611930600/0x6aae200528fe6443 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe644a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736237.078600:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff941611930600/0x6aae200528fe6443 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe644a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736237.078765:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b780a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816110080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790736237.078804:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736237.078917:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816110080 00000100:00100000:3.0:1790736237.078924:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816110080 00000100:00100000:3.0:1790736237.078960:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1790736237.078969:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416055c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+17:5841:x1877722816110080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790736237.079320:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416055c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+17:5841:x1877722816110080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 352us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736237.079328:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1790736237.086820:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941605768900 going to sleep for 11 seconds 00000100:00100000:2.0:1790736237.086892:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b780a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816110080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790736237.086994:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b780a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816110208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790736237.087123:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736237.087170:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941605768900 going to sleep for 11 seconds 00000100:00100000:3.0:1790736237.088523:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816110208 00000100:00100000:3.0:1790736237.088542:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816110208 00000100:00100000:3.0:1790736237.088638:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1790736237.088650:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94161094ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+17:5841:x1877722816110208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790736237.088960:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94161094ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+17:5841:x1877722816110208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 312us (1837us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736237.088969:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1790736237.089165:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b780a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816110208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790736237.100737:0:11700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b780a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:11700:1877722816110336:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790736237.100882:0:11700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736237.100954:0:11700:0:(client.c:2716:ptlrpc_set_wait()) set ffff941605768000 going to sleep for 11 seconds 00000100:00100000:0.0:1790736237.101156:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816110336 00000100:00100000:0.0:1790736237.101166:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816110336 00000100:00100000:0.0:1790736237.101230:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1790736237.101243:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416055c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+17:11700:x1877722816110336:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790736237.101563:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416055c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+17:11700:x1877722816110336:12345-0@lo:502:llog_process_th.0 Request processed in 321us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736237.101572:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1790736237.101873:0:11700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b780a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:11700:1877722816110336:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790736237.101910:0:11700:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790736237.101921:0:11700:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790736237.101924:0:11700:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790736237.101931:0:11700:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94162d364800 00000020:00000080:2.0:1790736237.101934:0:11700:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790736237.102030:0:11700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b780a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:11700:1877722816110464:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790736237.102070:0:11700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736237.102142:0:11700:0:(client.c:2716:ptlrpc_set_wait()) set ffff941605768000 going to sleep for 11 seconds 00000100:00100000:1.0:1790736237.102268:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816110464 00000100:00100000:1.0:1790736237.102275:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816110464 00000100:00100000:1.0:1790736237.102329:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1790736237.102337:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416055ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+17:11700:x1877722816110464:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790736237.102532:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416055ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+17:11700:x1877722816110464:12345-0@lo:502:llog_process_th.0 Request processed in 195us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736237.102540:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1790736237.102941:0:11700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b780a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:11700:1877722816110464:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790736237.102971:0:11700:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790736237.102977:0:11700:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790736237.102979:0:11700:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1790736237.102983:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1790736237.106537:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1790736237.106585:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790736237.106600:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff941611930600/0x6aae200528fe6443 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe644a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736237.106615:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff941611930600/0x6aae200528fe6443 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe644a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790736237.106636:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790736237.106640:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94162d353800 from 7 10000000:01000000:1.0:1790736237.106644:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790736237.106689:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff941633c61600/0x6aae200528fe6451 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736237.106698:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff941633c61600/0x6aae200528fe6451 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736237.106711:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff941633c61600/0x6aae200528fe6451 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736237.106741:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f242680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816110592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790736237.106831:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736237.106885:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941612005c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790736237.107162:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816110592 00000100:00100000:3.0:1790736237.107172:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816110592 00000100:00100000:3.0:1790736237.107229:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1790736237.107240:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+17:5841:x1877722816110592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790736237.107257:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736237.107275:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94162f8c9e00/0x6aae200528fe6458 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe6451 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736237.107304:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94162f8c9e00/0x6aae200528fe6458 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe6451 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736237.107315:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94162f8c9e00/0x6aae200528fe6458 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe6451 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736237.107324:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c9e00, rc 0) 00000100:00100000:3.0:1790736237.107378:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+18:5841:x1877722816110592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736237.107396:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1790736237.107865:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f242680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816110592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790736237.107902:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff941633c61600/0x6aae200528fe6451 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6458 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736237.107913:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff941633c61600/0x6aae200528fe6451 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe6458 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736237.107980:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f242680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816110720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790736237.108017:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736237.108821:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941612005c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790736237.113791:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816110720 00000100:00100000:3.0:1790736237.113815:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816110720 00000100:00100000:3.0:1790736237.113900:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1790736237.113914:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+18:5841:x1877722816110720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790736237.114350:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+18:5841:x1877722816110720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 437us (6330us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736237.114360:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1790736237.114547:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f242680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816110720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790736237.114621:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163393f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816110848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790736237.114768:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736237.131500:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816110848 00000100:00100000:1.0:1790736237.131522:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816110848 00000100:00100000:1.0:1790736237.131604:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1790736237.131616:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+18:5841:x1877722816110848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790736237.131770:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416338f7480 going to sleep for 11 seconds 00000100:00100000:1.0:1790736237.133362:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+18:5841:x1877722816110848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1737us (18583us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736237.133387:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1790736237.133409:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163393f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816110848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790736237.147840:0:11703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f240700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:11703:1877722816110976:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790736237.147955:0:11703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736237.148003:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816110976 00000100:00100000:1.0:1790736237.148013:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816110976 00000100:00100000:1.0:1790736237.148063:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1790736237.148072:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+18:11703:x1877722816110976:12345-0@lo:502:llog_process_th.0 00000040:00080000:3.0:1790736237.148480:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790736237.150862:0:11703:0:(client.c:2716:ptlrpc_set_wait()) set ffff941612005c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790736237.152885:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+18:11703:x1877722816110976:12345-0@lo:502:llog_process_th.0 Request processed in 4799us (4915us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736237.152904:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1790736237.153472:0:11703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f240700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:11703:1877722816110976:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790736237.153544:0:11703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790736237.153558:0:11703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790736237.153561:0:11703:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790736237.153568:0:11703:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94162d353800 00000020:00000080:2.0:1790736237.153571:0:11703:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790736237.153710:0:11703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b780a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:11703:1877722816111104:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790736237.153792:0:11703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736237.153842:0:11703:0:(client.c:2716:ptlrpc_set_wait()) set ffff941605768900 going to sleep for 11 seconds 00000100:00100000:3.0:1790736237.154135:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816111104 00000100:00100000:3.0:1790736237.154143:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816111104 00000100:00100000:3.0:1790736237.154208:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1790736237.154219:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+18:11703:x1877722816111104:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790736237.154588:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+18:11703:x1877722816111104:12345-0@lo:502:llog_process_th.0 Request processed in 369us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736237.154596:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1790736237.157454:0:11703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b780a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:11703:1877722816111104:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790736237.157514:0:11703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790736237.157524:0:11703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790736237.157527:0:11703:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1790736237.157533:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1790736237.159262:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1790736237.161840:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790736237.161864:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff941633c61600/0x6aae200528fe6451 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6458 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736237.161880:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff941633c61600/0x6aae200528fe6451 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6458 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790736237.161894:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790736237.161897:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff941604c0d800 from 7 10000000:01000000:1.0:1790736237.161900:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790736237.161946:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff941633c61a00/0x6aae200528fe645f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736237.161955:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff941633c61a00/0x6aae200528fe645f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736237.161968:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff941633c61a00/0x6aae200528fe645f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736237.161999:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f241f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816111232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790736237.162113:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736237.162175:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611c7d180 going to sleep for 11 seconds 00000100:00100000:0.0:1790736237.166127:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816111232 00000100:00100000:0.0:1790736237.166146:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816111232 00000100:00100000:0.0:1790736237.166226:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1790736237.166238:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+18:5841:x1877722816111232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790736237.166261:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736237.166287:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941642173000/0x6aae200528fe6466 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe645f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736237.166424:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941642173000/0x6aae200528fe6466 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe645f expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736237.166438:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941642173000/0x6aae200528fe6466 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe645f expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736237.166449:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941642173000, rc 0) 00000100:00100000:0.0:1790736237.166598:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+19:5841:x1877722816111232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 362us (4506us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736237.166606:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1790736237.168773:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f241f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816111232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790736237.168813:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff941633c61a00/0x6aae200528fe645f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6466 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736237.168827:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff941633c61a00/0x6aae200528fe645f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe6466 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736237.168931:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f241f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816111360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790736237.169010:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736237.169132:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611c7d180 going to sleep for 11 seconds 00000100:00100000:2.0:1790736237.171424:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816111360 00000100:00100000:2.0:1790736237.171445:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816111360 00000100:00100000:2.0:1790736237.171556:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1790736237.171568:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+19:5841:x1877722816111360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790736237.171989:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+19:5841:x1877722816111360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 422us (2978us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736237.171998:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1790736237.172513:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f241f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816111360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790736237.172581:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163393f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816111488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790736237.172657:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736237.174116:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416338f7600 going to sleep for 11 seconds 00000100:00100000:1.0:1790736237.175428:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816111488 00000100:00100000:1.0:1790736237.175443:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816111488 00000100:00100000:1.0:1790736237.175507:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1790736237.175519:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+19:5841:x1877722816111488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790736237.175845:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+19:5841:x1877722816111488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 327us (3186us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736237.175855:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1790736237.176362:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163393f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52e04a2b-4e01-44b7-985c-7db034e22389:5841:1877722816111488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790736237.179698:0:11707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b780a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:11707:1877722816111616:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790736237.179819:0:11707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736237.179878:0:11707:0:(client.c:2716:ptlrpc_set_wait()) set ffff941605768b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790736237.179938:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816111616 00000100:00100000:3.0:1790736237.179948:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816111616 00000100:00100000:3.0:1790736237.180024:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1790736237.180035:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+19:11707:x1877722816111616:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790736237.180499:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+19:11707:x1877722816111616:12345-0@lo:502:llog_process_th.0 Request processed in 464us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736237.180508:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1790736237.180904:0:11707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b780a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:11707:1877722816111616:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790736237.181013:0:11707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790736237.181026:0:11707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790736237.181030:0:11707:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790736237.181045:0:11707:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff941604c0d800 00000020:00000080:3.0:1790736237.181047:0:11707:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790736237.181480:0:11707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:11707:1877722816111744:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790736237.181544:0:11707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736237.181586:0:11707:0:(client.c:2716:ptlrpc_set_wait()) set ffff941637e9b900 going to sleep for 11 seconds 00000100:00100000:0.0:1790736237.181904:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816111744 00000100:00100000:0.0:1790736237.181911:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816111744 00000100:00100000:0.0:1790736237.182002:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1790736237.182014:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+19:11707:x1877722816111744:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790736237.188062:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+19:11707:x1877722816111744:12345-0@lo:502:llog_process_th.0 Request processed in 6037us (6504us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736237.188082:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1790736237.191110:0:11707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52e04a2b-4e01-44b7-985c-7db034e22389:11707:1877722816111744:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790736237.191175:0:11707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790736237.191187:0:11707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790736237.191189:0:11707:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1790736237.191195:0:11707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1790736237.193185:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1790736237.193229:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790736237.193252:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff941633c61a00/0x6aae200528fe645f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6466 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736237.193269:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff941633c61a00/0x6aae200528fe645f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6466 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736237.247026:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736237.247210:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797200896 00000100:00100000:1.0:1790736237.247224:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797200896 00000100:00100000:1.0:1790736237.247299:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 266 00000100:00100000:1.0:1790736237.247310:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160554c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+11:5596:x1877722797200896:12345-192.168.203.5@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790736237.247334:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736237.247361:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941633c61e00/0x6aae200528fe646d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x92962417a526d94 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736237.247397:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941633c61e00/0x6aae200528fe646d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d94 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736237.247410:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941633c61e00/0x6aae200528fe646d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d94 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736237.247421:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c61e00, rc 0) 00000100:00100000:1.0:1790736237.247540:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160554c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+12:5596:x1877722797200896:12345-192.168.203.5@tcp:101:ll_cfg_requeue.0 Request processed in 231us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736237.247547:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 266 00000100:00100000:1.0:1790736237.259312:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736237.259418:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797201024 00000100:00100000:0.0:1790736237.259431:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797201024 00000100:00100000:0.0:1790736237.259501:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 267 00000100:00100000:0.0:1790736237.259513:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+12:5596:x1877722797201024:12345-192.168.203.5@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790736237.259953:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+12:5596:x1877722797201024:12345-192.168.203.5@tcp:501:ll_cfg_requeue.0 Request processed in 438us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736237.259964:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 267 00000100:00100000:2.0:1790736237.264582:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736237.264689:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797201152 00000100:00100000:3.0:1790736237.264704:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797201152 00000100:00100000:3.0:1790736237.264780:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 268 00000100:00100000:3.0:1790736237.264792:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+12:5596:x1877722797201152:12345-192.168.203.5@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790736237.268826:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+12:5596:x1877722797201152:12345-192.168.203.5@tcp:503:ll_cfg_requeue.0 Request processed in 4018us (4239us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736237.268848:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 268 00000100:00100000:2.0:1790736237.282515:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736237.289918:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797201280 00000100:00100000:1.0:1790736237.290136:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797201280 00000100:00100000:0.0:1790736237.290434:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 269 00000100:00100000:0.0:1790736237.290457:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+12:9938:x1877722797201280:12345-192.168.203.5@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790736237.290835:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+12:9938:x1877722797201280:12345-192.168.203.5@tcp:502:llog_process_th.0 Request processed in 380us (8333us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736237.290854:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 269 00000100:00100000:1.0:1790736237.294683:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736237.306697:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797201408 00000100:00100000:2.0:1790736237.306719:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797201408 00000100:00100000:2.0:1790736237.306822:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 270 00000100:00100000:2.0:1790736237.306835:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+12:9938:x1877722797201408:12345-192.168.203.5@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790736237.307210:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+12:9938:x1877722797201408:12345-192.168.203.5@tcp:502:llog_process_th.0 Request processed in 376us (12539us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736237.307220:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 270 00000100:00100000:3.0:1790736237.312993:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736237.314167:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797201536 00000100:00100000:2.0:1790736237.314185:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797201536 00000100:00100000:2.0:1790736237.314269:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 271 00000100:00100000:2.0:1790736237.314282:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+12:5596:x1877722797201536:12345-192.168.203.5@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790736237.314309:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736237.314335:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941611930800/0x6aae200528fe6474 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x92962417a526d9b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736237.314383:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941611930800/0x6aae200528fe6474 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d9b expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736237.314417:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941611930800/0x6aae200528fe6474 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d9b expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736237.314429:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611930800, rc 0) 00000100:00100000:2.0:1790736237.314521:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+13:5596:x1877722797201536:12345-192.168.203.5@tcp:101:ll_cfg_requeue.0 Request processed in 242us (1541us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736237.314529:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 271 00000100:00100000:1.0:1790736237.323278:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736237.323380:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797201664 00000100:00100000:3.0:1790736237.323394:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797201664 00000100:00100000:3.0:1790736237.323472:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 272 00000100:00100000:3.0:1790736237.323483:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+13:5596:x1877722797201664:12345-192.168.203.5@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790736237.324081:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+13:5596:x1877722797201664:12345-192.168.203.5@tcp:501:ll_cfg_requeue.0 Request processed in 597us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736237.324147:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 272 00000100:00100000:1.0:1790736237.330918:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736237.331263:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797201792 00000100:00100000:0.0:1790736237.331278:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797201792 00000100:00100000:0.0:1790736237.331359:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 273 00000100:00100000:0.0:1790736237.331373:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+13:5596:x1877722797201792:12345-192.168.203.5@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790736237.332166:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+13:5596:x1877722797201792:12345-192.168.203.5@tcp:503:ll_cfg_requeue.0 Request processed in 791us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736237.332177:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 273 00010000:00010000:1.0:1790736237.338586:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790736237.352047:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736237.352829:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797201920 00000100:00100000:2.0:1790736237.352844:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797201920 00000100:00100000:2.0:1790736237.352921:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 274 00000100:00100000:2.0:1790736237.352932:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+13:9941:x1877722797201920:12345-192.168.203.5@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790736237.353297:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+13:9941:x1877722797201920:12345-192.168.203.5@tcp:502:llog_process_th.0 Request processed in 364us (1265us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736237.353307:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 274 00000100:00100000:1.0:1790736237.359314:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736237.359544:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797202048 00000100:00100000:3.0:1790736237.359557:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797202048 00000100:00100000:3.0:1790736237.359632:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 275 00000100:00100000:3.0:1790736237.359643:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+13:9941:x1877722797202048:12345-192.168.203.5@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790736237.360723:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+13:9941:x1877722797202048:12345-192.168.203.5@tcp:502:llog_process_th.0 Request processed in 1076us (1419us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736237.360736:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 275 00000100:00100000:2.0:1790736237.717982:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790736237.718016:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163393f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816111872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790736237.718146:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736237.718303:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816111872 00000100:00100000:0.0:1790736237.718313:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816111872 00000100:00100000:0.0:1790736237.718400:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790736237.718412:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b780a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1877722816111872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790736237.718474:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790736237.718542:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b780a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1877722816111872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736237.718550:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790736237.718684:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163393f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816111872:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790736237.718875:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1790736238.166150:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790736238.360722:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736238.593915:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736238.593974:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736238.594842:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736238.594888:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736238.595162:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797202176 00000100:00100000:0.0:1790736238.595176:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797202176 00000100:00100000:0.0:1790736238.595251:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 276 00000100:00100000:0.0:1790736238.595263:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+13:2354:x1877722797202176:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1790736238.595479:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797202304 00000100:00100000:2.0:1790736238.595486:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797202304 00000100:00100000:2.0:1790736238.595531:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797202560 00000100:00100000:2.0:1790736238.595534:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797202560 00000100:00100000:2.0:1790736238.595557:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 106 00000100:00100000:2.0:1790736238.595565:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2354:x1877722797202304:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736238.595741:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 107 00000100:00100000:3.0:1790736238.595762:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f242d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2353:x1877722797202560:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1790736238.595846:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+13:2354:x1877722797202176:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 585us (1946us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736238.595856:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 276 00000100:00100000:2.0:1790736238.598522:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2354:x1877722797202304:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 2938us (4527us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736238.598540:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 106 00000100:00100000:2.0:1790736238.598644:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797202432 00000100:00100000:2.0:1790736238.598664:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797202432 00000100:00100000:2.0:1790736238.598739:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 60 00000100:00100000:2.0:1790736238.598759:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2353:x1877722797202432:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1790736238.598816:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2353:x1877722797202432:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 60us (3927us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736238.598823:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 60 00000100:00080000:2.0:1790736238.598843:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790736238.598849:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790736238.599394:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f242d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2353:x1877722797202560:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 3628us (4551us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736238.599405:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 107 00000100:00100000:3.0:1790736238.746201:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877722816112128:0@lo:400:kworker.0 00000100:00100000:3.0:1790736238.746300:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736238.746381:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b30b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816112640:0@lo:400:kworker.0 00000100:00100000:3.0:1790736238.746413:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736238.746452:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790736238.746458:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1877722816112256:0@lo:400:kworker.0 00000100:00100000:3.0:1790736238.746482:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736238.746523:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816112128 00000100:00100000:3.0:1790736238.746533:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816112128 00000100:00100000:3.0:1790736238.746586:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816112256 00000100:00100000:3.0:1790736238.746589:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816112256 00000100:00100000:3.0:1790736238.746640:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1790736238.746651:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877722816112128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736238.746717:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877722816112128:12345-0@lo:400:kworker.0 Request processed in 68us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736238.746755:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1790736238.746784:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1790736238.746791:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877722816112256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736238.746950:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877722816112256:12345-0@lo:400:kworker.0 Request processed in 159us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736238.746957:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1790736238.747002:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1877722816112256:0@lo:400:kworker.0 00000100:00100000:3.0:1790736238.747013:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877722816112128:0@lo:400:kworker.0 00000100:00080000:3.0:1790736238.747045:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790736238.747386:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52e04a2b-4e01-44b7-985c-7db034e22389:3309:1877722816112000:0@lo:400:kworker.0 00000100:00100000:2.0:1790736238.747434:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736238.747480:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1877722816112512:0@lo:400:kworker.0 00000100:00100000:2.0:1790736238.747505:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736238.747526:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790736238.747532:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816112384:0@lo:400:kworker.0 00000100:00100000:2.0:1790736238.747557:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736238.747662:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816112640 00000100:00100000:0.0:1790736238.747682:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816112640 00000100:00100000:0.0:1790736238.747734:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816112384 00000100:00100000:0.0:1790736238.747738:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816112384 00000100:00100000:0.0:1790736238.747780:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790736238.747788:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816112640:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1790736238.747954:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790736238.747988:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790736238.747998:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1877722816112384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736238.748065:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816112512 00000100:00100000:3.0:1790736238.748069:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816112512 00000100:00100000:3.0:1790736238.748127:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790736238.748136:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877722816112512:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1790736238.749564:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790736238.749586:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816112000 00000100:00100000:1.0:1790736238.749596:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816112000 00000100:00100000:1.0:1790736238.749652:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1790736238.749662:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+19:3309:x1877722816112000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736238.749811:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1877722816112384:12345-0@lo:400:kworker.0 Request processed in 1812us (2249us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736238.749832:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790736238.749935:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816112384:0@lo:400:kworker.0 00000100:00100000:3.0:1790736238.751124:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877722816112512:12345-0@lo:400:kworker.0 Request processed in 2981us (3608us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736238.751137:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1790736238.751615:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1877722816112512:0@lo:400:kworker.0 00000100:00100000:0.0:1790736238.751803:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816112640:12345-0@lo:400:kworker.0 Request processed in 4014us (5386us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736238.751814:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:3.0:1790736238.751975:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163b30b800 x1877722816112640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736238.751989:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b30b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816112640:0@lo:400:kworker.0 00000100:00100000:1.0:1790736238.752268:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+19:3309:x1877722816112000:12345-0@lo:400:kworker.0 Request processed in 2605us (4830us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736238.752279:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1790736238.752395:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52e04a2b-4e01-44b7-985c-7db034e22389:3309:1877722816112000:0@lo:400:kworker.0 00000100:00100000:0.0:1790736239.254444:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790736239.255705:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b30b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816112768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790736239.255822:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736239.257406:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816112768 00000100:00100000:1.0:1790736239.257433:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816112768 00000100:00100000:1.0:1790736239.257528:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790736239.257540:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163393c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816112768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790736239.257603:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790736239.258123:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163393c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816112768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 554us (2269us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736239.258134:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1790736239.258671:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163b30b800 x1877722816112768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736255 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736239.264296:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b30b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816112768:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790736239.384863:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790736239.940949:0:6725:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:1.0:1790736240.405310:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736241.432408:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736242.456641:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736242.844945:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790736242.844994:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163393ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816112896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790736242.845134:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736242.845466:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816112896 00000100:00100000:1.0:1790736242.845479:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816112896 00000100:00100000:1.0:1790736242.845562:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790736242.845584:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816112896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790736242.845632:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790736242.845696:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816112896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736242.845703:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1790736242.845964:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790736242.846177:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1790736242.846185:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94162f240000, transno 4294967300 00000100:00100000:3.0:1790736242.846218:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163393ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816112896:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790736243.480194:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736243.712546:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736243.712623:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736243.712725:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797202688 00000100:00100000:0.0:1790736243.712739:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797202688 00000100:00100000:0.0:1790736243.712814:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 278 00000100:00100000:0.0:1790736243.712826:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+13:2355:x1877722797202688:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1790736243.712923:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+13:2355:x1877722797202688:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 100us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736243.712930:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 278 00000100:00100000:3.0:1790736243.713023:0:8632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797202944 00000100:00100000:3.0:1790736243.713028:0:8632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797202944 00000100:00080000:2.0:1790736243.713276:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790736243.713498:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 63 00000100:00100000:3.0:1790736243.713511:0:8632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2355:x1877722797202944:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736243.713569:0:8632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2355:x1877722797202944:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 61us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736243.713577:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 63 00000100:00100000:1.0:1790736243.716624:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736243.716701:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736243.716863:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797202816 00000100:00100000:3.0:1790736243.716877:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797202816 00000100:00100000:3.0:1790736243.716961:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797203072 00000100:00100000:3.0:1790736243.716964:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797203072 00000100:00100000:3.0:1790736243.716993:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 111 00000100:00100000:3.0:1790736243.717004:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2355:x1877722797202816:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736243.717263:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2355:x1877722797202816:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 259us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736243.717273:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 111 00000100:00100000:3.0:1790736243.717295:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 112 00000100:00100000:3.0:1790736243.717302:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2355:x1877722797203072:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736243.717331:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2355:x1877722797203072:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 30us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736243.717363:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 112 00000100:00080000:2.0:1790736243.717624:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790736243.861931:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790736243.862229:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877722816113152:0@lo:400:kworker.0 00000100:00100000:2.0:1790736243.862237:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1877722816113280:0@lo:400:kworker.0 00000100:00100000:2.0:1790736243.862344:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736243.864268:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816113280 00000100:00100000:2.0:1790736243.864289:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816113280 00000100:00100000:2.0:1790736243.864374:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1790736243.864386:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877722816113280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736243.865362:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736243.865471:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816113152 00000100:00100000:0.0:1790736243.865479:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816113152 00000100:00100000:0.0:1790736243.865519:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1790736243.865529:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163393ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877722816113152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736243.865669:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163393ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877722816113152:12345-0@lo:400:kworker.0 Request processed in 141us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736243.865678:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1790736243.865767:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877722816113152:0@lo:400:kworker.0 00000100:00080000:0.0:1790736243.865809:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790736243.866069:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816113408:0@lo:400:kworker.0 00000100:00100000:1.0:1790736243.866267:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736243.866304:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816113408 00000100:00100000:1.0:1790736243.866311:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816113408 00000100:00100000:1.0:1790736243.866345:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790736243.866352:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f243100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816113408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736243.866392:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f243100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816113408:12345-0@lo:400:kworker.0 Request processed in 40us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736243.866399:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790736243.866443:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816113408:0@lo:400:kworker.0 00000100:00100000:1.0:1790736243.866461:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816113024:0@lo:400:kworker.0 00000100:00100000:1.0:1790736243.866494:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736243.866518:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816113024 00000100:00100000:1.0:1790736243.866523:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816113024 00000100:00100000:1.0:1790736243.866552:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1790736243.866559:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+19:3308:x1877722816113024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736243.866590:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+19:3308:x1877722816113024:12345-0@lo:400:kworker.0 Request processed in 31us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736243.866597:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1790736243.866731:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816113024:0@lo:400:kworker.0 00000100:00100000:3.0:1790736243.867070:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790736243.867082:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816113664:0@lo:400:kworker.0 00000100:00100000:3.0:1790736243.867146:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736243.867178:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816113664 00000100:00100000:3.0:1790736243.867183:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816113664 00000100:00100000:3.0:1790736243.867218:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790736243.867226:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162edc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816113664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736243.867281:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162edc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816113664:12345-0@lo:400:kworker.0 Request processed in 56us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736243.867288:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:3.0:1790736243.867321:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94162edc7b80 x1877722816113664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736243.867335:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816113664:0@lo:400:kworker.0 00000100:00100000:1.0:1790736243.867642:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790736243.867724:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1877722816113536:0@lo:400:kworker.0 00000100:00100000:1.0:1790736243.867766:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736243.867910:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816113536 00000100:00100000:3.0:1790736243.867916:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816113536 00000100:00100000:2.0:1790736243.868339:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877722816113280:12345-0@lo:400:kworker.0 Request processed in 3953us (5991us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736243.868350:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790736243.868783:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1877722816113280:0@lo:400:kworker.0 00000100:00080000:0.0:1790736243.868971:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790736243.869261:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1790736243.869273:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877722816113536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736243.869361:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877722816113536:12345-0@lo:400:kworker.0 Request processed in 92us (1595us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736243.869369:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1790736243.869444:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1877722816113536:0@lo:400:kworker.0 00000100:00080000:0.0:1790736243.871337:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790736244.373530:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790736244.373850:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816113792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790736244.373972:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736244.374226:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816113792 00000100:00100000:1.0:1790736244.374238:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816113792 00000100:00100000:1.0:1790736244.374431:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790736244.374447:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163393d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816113792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790736244.374523:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790736244.374593:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163393d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816113792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736244.374601:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:3.0:1790736244.374818:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94162edc7b80 x1877722816113792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736260 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736244.374842:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816113792:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790736244.502483:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736245.525352:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736246.553800:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736247.575311:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790736247.958998:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163393dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816113920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790736247.959125:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736247.960574:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816113920 00000100:00100000:1.0:1790736247.960592:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816113920 00000100:00100000:1.0:1790736247.960733:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790736247.960746:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816113920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790736247.960810:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790736247.960928:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816113920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 185us (1804us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736247.960936:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1790736247.961128:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790736247.963932:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163393dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816113920:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1790736248.407191:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790736248.599038:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736248.836528:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736248.836594:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736248.836636:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736248.836683:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736248.836822:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797203456 00000100:00100000:3.0:1790736248.836836:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797203456 00000100:00100000:3.0:1790736248.836926:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 66 00000100:00100000:3.0:1790736248.836941:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2354:x1877722797203456:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736248.837033:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2354:x1877722797203456:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 98us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736248.837042:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 66 00000100:00100000:2.0:1790736248.837137:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797203200 00000100:00100000:2.0:1790736248.837143:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797203200 00000100:00100000:2.0:1790736248.837187:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 280 00000100:00100000:2.0:1790736248.837194:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+13:2354:x1877722797203200:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1790736248.837226:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+13:2354:x1877722797203200:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 33us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736248.837251:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 280 00000100:00100000:2.0:1790736248.837288:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797203328 00000100:00100000:2.0:1790736248.837292:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797203328 00000100:00100000:2.0:1790736248.837319:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797203584 00000100:00100000:2.0:1790736248.837323:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797203584 00000100:00100000:2.0:1790736248.837346:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 116 00000100:00100000:2.0:1790736248.837353:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2354:x1877722797203328:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1790736248.837385:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2354:x1877722797203328:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 32us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736248.837392:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 116 00000100:00100000:2.0:1790736248.837404:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 117 00000100:00100000:2.0:1790736248.837410:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160838dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2354:x1877722797203584:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1790736248.837433:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160838dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2354:x1877722797203584:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 24us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736248.837440:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 117 00000100:00080000:1.0:1790736248.837936:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790736248.837944:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790736248.981570:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163393e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1877722816114304:0@lo:400:kworker.0 00000100:00100000:0.0:1790736248.981682:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736248.981769:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790736248.981775:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163393ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877722816114176:0@lo:400:kworker.0 00000100:00100000:0.0:1790736248.981797:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736248.981814:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163393df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816114688:0@lo:400:kworker.0 00000100:00100000:0.0:1790736248.981840:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736248.981877:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816114304 00000100:00100000:0.0:1790736248.981897:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816114304 00000100:00100000:0.0:1790736248.981956:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816114176 00000100:00100000:0.0:1790736248.981959:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816114176 00000100:00100000:0.0:1790736248.981977:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1790736248.981986:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163393d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877722816114304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736248.982048:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163393d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877722816114304:12345-0@lo:400:kworker.0 Request processed in 62us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736248.982065:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1790736248.982085:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1790736248.982090:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163393c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877722816114176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736248.982170:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163393c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877722816114176:12345-0@lo:400:kworker.0 Request processed in 80us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736248.982176:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1790736248.982222:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163393ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877722816114176:0@lo:400:kworker.0 00000100:00100000:0.0:1790736248.982232:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163393e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1877722816114304:0@lo:400:kworker.0 00000100:00100000:3.0:1790736248.982556:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163393e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816114432:0@lo:400:kworker.0 00000100:00100000:3.0:1790736248.982595:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736248.982623:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1790736248.982629:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163393f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816114048:0@lo:400:kworker.0 00000100:00100000:3.0:1790736248.982655:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736248.982689:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163393ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1877722816114560:0@lo:400:kworker.0 00000100:00100000:3.0:1790736248.982711:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736248.982739:0:8632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816114688 00000100:00100000:3.0:1790736248.982744:0:8632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816114688 00000100:00100000:3.0:1790736248.982773:0:8632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816114432 00000100:00100000:3.0:1790736248.982776:0:8632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816114432 00000100:00100000:3.0:1790736248.982793:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790736248.982800:0:8632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163393f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816114688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736248.982835:0:8632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163393f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816114688:12345-0@lo:400:kworker.0 Request processed in 37us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736248.982841:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790736248.982853:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790736248.982867:0:8632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162edc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816114432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736248.982908:0:8632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162edc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816114432:12345-0@lo:400:kworker.0 Request processed in 41us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736248.982913:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790736248.982947:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163393e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816114432:0@lo:400:kworker.0 00000100:00100000:3.0:1790736248.982965:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816114560 00000100:00100000:3.0:1790736248.982968:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816114560 00000100:00100000:3.0:1790736248.982990:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1790736248.982996:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162edc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877722816114560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736248.983027:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162edc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877722816114560:12345-0@lo:400:kworker.0 Request processed in 31us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736248.983033:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1790736248.984236:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163393ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1877722816114560:0@lo:400:kworker.0 00000100:00100000:1.0:1790736248.984733:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816114048 00000100:00100000:1.0:1790736248.984743:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816114048 00000100:00100000:1.0:1790736248.984797:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1790736248.984806:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+19:3308:x1877722816114048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736248.984899:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+19:3308:x1877722816114048:12345-0@lo:400:kworker.0 Request processed in 94us (2242us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736248.984907:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00080000:1.0:1790736248.984956:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790736248.984963:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790736248.984984:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163393f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816114048:0@lo:400:kworker.0 00010000:00080000:0.0:1790736248.986710:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163393df80 x1877722816114688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790736248.986732:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163393df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816114688:0@lo:400:kworker.0 00000100:00100000:0.0:1790736249.493506:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816114816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790736249.493625:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736249.493842:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816114816 00000100:00100000:1.0:1790736249.493855:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816114816 00000100:00100000:1.0:1790736249.493942:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790736249.493954:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163393df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816114816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790736249.494031:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790736249.494137:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163393df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816114816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 184us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736249.494145:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1790736249.494251:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94162edc6680 x1877722816114816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736265 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736249.494277:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816114816:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790736249.624507:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736250.647479:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736251.669413:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736252.693513:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736253.077604:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163393e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816114944:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790736253.077718:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736253.077934:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816114944 00000100:00100000:3.0:1790736253.077945:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816114944 00000100:00100000:3.0:1790736253.078025:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790736253.078037:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162ed90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816114944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790736253.078087:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790736253.078178:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162ed90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816114944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736253.078186:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790736253.078242:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163393e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816114944:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790736253.078385:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790736253.720179:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736253.953232:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736253.953285:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736253.953392:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797203840 00000100:00100000:0.0:1790736253.953405:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797203840 00000100:00100000:0.0:1790736253.953521:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 121 00000100:00100000:0.0:1790736253.953533:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162ed90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2355:x1877722797203840:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1790736253.953654:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162ed90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2355:x1877722797203840:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 123us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736253.953663:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 121 00000100:00100000:3.0:1790736253.953883:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797203712 00000100:00100000:3.0:1790736253.953889:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797203712 00000100:00100000:3.0:1790736253.953931:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 282 00000100:00100000:3.0:1790736253.953939:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416031e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+13:2355:x1877722797203712:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736253.953973:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416031e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+13:2355:x1877722797203712:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 35us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736253.953980:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 282 00000100:00080000:1.0:1790736253.954114:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790736253.980258:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736253.980317:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736253.981842:0:8632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797203968 00000100:00100000:3.0:1790736253.981862:0:8632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797203968 00000100:00100000:3.0:1790736253.981974:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 19 00000100:00100000:3.0:1790736253.981987:0:8632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162ed91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2352:x1877722797203968:12345-192.168.203.5@tcp:9:kworker.0 00000020:00000080:3.0:1790736253.982026:0:8632:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6aae200528fe63b0 00000100:00080000:3.0:1790736253.982036:0:8632:0:(import.c:65:import_set_state_nolock()) ffff94163c633000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790736253.982089:0:8632:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1790736253.982493:0:8632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162ed91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+2:2352:x1877722797203968:12345-192.168.203.5@tcp:9:kworker.0 Request processed in 507us (2250us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736253.982502:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 19 00010000:00010000:3.0:1790736253.982531:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790736253.982753:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790736253.982870:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797204096 00000100:00100000:0.0:1790736253.982877:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797204096 00000100:00100000:0.0:1790736253.982937:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 122 00000100:00100000:0.0:1790736253.982948:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162ed92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2355:x1877722797204096:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1790736253.982995:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162ed92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2355:x1877722797204096:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 50us (2677us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736253.983021:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 122 00000100:00080000:1.0:1790736253.983124:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790736254.102793:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163393ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52e04a2b-4e01-44b7-985c-7db034e22389:3309:1877722816115072:0@lo:400:kworker.0 00000100:00100000:1.0:1790736254.102909:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736254.103158:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816115072 00000100:00100000:3.0:1790736254.103171:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816115072 00000100:00100000:3.0:1790736254.103236:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1790736254.103248:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606656850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+19:3309:x1877722816115072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736254.103753:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163393e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877722816115200:0@lo:400:kworker.0 00000100:00100000:2.0:1790736254.103802:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736254.103842:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790736254.103849:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163393f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1877722816115328:0@lo:400:kworker.0 00000100:00100000:2.0:1790736254.103886:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736254.103921:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816115200 00000100:00100000:2.0:1790736254.103928:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816115200 00000100:00100000:3.0:1790736254.103940:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606656850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+19:3309:x1877722816115072:12345-0@lo:400:kworker.0 Request processed in 692us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736254.103950:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1790736254.103968:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816115328 00000100:00100000:2.0:1790736254.103973:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816115328 00000100:00100000:3.0:1790736254.104001:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163393ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816115456:0@lo:400:kworker.0 00000100:00100000:2.0:1790736254.104011:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1790736254.104019:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877722816115200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736254.104068:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736254.104128:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816115456 00000100:00100000:3.0:1790736254.104132:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816115456 00000100:00100000:3.0:1790736254.104163:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790736254.104170:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162edc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816115456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736254.104210:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162edc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816115456:12345-0@lo:400:kworker.0 Request processed in 41us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736254.104216:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790736254.104259:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163393ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816115456:0@lo:400:kworker.0 00000100:00100000:3.0:1790736254.104514:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1790736254.104524:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877722816115328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736254.104565:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877722816115328:12345-0@lo:400:kworker.0 Request processed in 43us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736254.104572:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:3.0:1790736254.104619:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790736254.104668:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163393f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1877722816115328:0@lo:400:kworker.0 00000100:00100000:2.0:1790736254.104856:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877722816115200:12345-0@lo:400:kworker.0 Request processed in 836us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736254.104864:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1790736254.106677:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163393ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52e04a2b-4e01-44b7-985c-7db034e22389:3309:1877722816115072:0@lo:400:kworker.0 00000100:00100000:1.0:1790736254.106736:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163393e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1877722816115584:0@lo:400:kworker.0 00000100:00100000:3.0:1790736254.106779:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790736254.106798:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163393dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816115712:0@lo:400:kworker.0 00000100:00100000:1.0:1790736254.106822:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736254.106917:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816115584 00000100:00100000:0.0:1790736254.106927:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816115584 00000100:00100000:0.0:1790736254.107011:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1790736254.107031:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162ed93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877722816115584:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1790736254.107164:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790736254.107538:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162ed93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877722816115584:12345-0@lo:400:kworker.0 Request processed in 517us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736254.107547:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1790736254.107622:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163393e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877722816115200:0@lo:400:kworker.0 00000100:00100000:1.0:1790736254.107772:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163393e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1877722816115584:0@lo:400:kworker.0 00000100:00100000:3.0:1790736254.107819:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736254.107988:0:8632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816115712 00000100:00100000:0.0:1790736254.107995:0:8632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816115712 00000100:00080000:2.0:1790736254.108230:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790736254.108268:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790736254.108277:0:8632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162edc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816115712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736254.108514:0:8632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162edc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816115712:12345-0@lo:400:kworker.0 Request processed in 237us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736254.108521:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:3.0:1790736254.108646:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163393dc00 x1877722816115712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736254.108662:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163393dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816115712:0@lo:400:kworker.0 00000100:00100000:0.0:1790736254.614190:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163ad18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816115840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790736254.614291:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736254.614589:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816115840 00000100:00100000:1.0:1790736254.614602:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816115840 00000100:00100000:1.0:1790736254.614673:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790736254.614702:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163393ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816115840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790736254.614754:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790736254.614823:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163393ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816115840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736254.614830:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1790736254.615192:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163ad18e00 x1877722816115840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736270 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736254.615215:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163ad18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816115840:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790736254.741420:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790736255.195319:0:6725:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f945944d-9086-46a2-a91c-8bc7b88e8918 00000020:00000080:1.0:1790736255.195331:0:6725:0:(genops.c:885:class_export_put()) final put ffff94163c632000/f945944d-9086-46a2-a91c-8bc7b88e8918 00000020:00000080:2.0:1790736255.195375:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94163c632000/f945944d-9086-46a2-a91c-8bc7b88e8918 for lustre-OST0000 00000020:00000080:2.0:1790736255.195440:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94163c633000 for lustre-OST0000 00010000:00010000:0.0:1790736255.765519:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736256.795841:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736257.815451:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736258.197243:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163ad18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816115968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790736258.197315:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736258.197399:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816115968 00000100:00100000:3.0:1790736258.197407:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816115968 00000100:00100000:3.0:1790736258.197475:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790736258.197484:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ad19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816115968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790736258.197531:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790736258.197574:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ad19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816115968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736258.197581:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1790736258.197613:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790736258.197659:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163ad18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816115968:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1790736258.646716:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790736258.838607:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736259.073526:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736259.073577:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736259.073619:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736259.073893:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797204224 00000100:00100000:0.0:1790736259.073905:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797204224 00000100:00100000:0.0:1790736259.073968:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 284 00000100:00100000:0.0:1790736259.073978:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606657c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+13:2356:x1877722797204224:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1790736259.074052:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606657c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+13:2356:x1877722797204224:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 75us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736259.074078:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 284 00000100:00100000:2.0:1790736259.075699:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797204480 00000100:00100000:2.0:1790736259.075711:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797204480 00000100:00100000:2.0:1790736259.075807:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797204352 00000100:00100000:2.0:1790736259.075811:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797204352 00000100:00100000:2.0:1790736259.075847:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 126 00000100:00100000:2.0:1790736259.075856:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162ed92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2356:x1877722797204480:12345-192.168.203.5@tcp:400:kworker.0 00000100:00080000:0.0:1790736259.075902:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790736259.075937:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162ed92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2356:x1877722797204480:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 81us (2358us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736259.075948:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 127 00000100:00100000:0.0:1790736259.075960:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162ed92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2356:x1877722797204352:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1790736259.075996:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162ed92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2356:x1877722797204352:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 41us (2377us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736259.086213:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 126 00000100:00100000:0.0:1790736259.087236:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 127 00000100:00100000:2.0:1790736259.221592:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163393dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877722816116224:0@lo:400:kworker.0 00000100:00100000:1.0:1790736259.221612:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163393e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816116480:0@lo:400:kworker.0 00000100:00100000:3.0:1790736259.221698:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163393f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52e04a2b-4e01-44b7-985c-7db034e22389:3309:1877722816116096:0@lo:400:kworker.0 00000100:00100000:2.0:1790736259.224976:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736259.225181:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163393f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816116736:0@lo:400:kworker.0 00000100:00100000:2.0:1790736259.225224:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736259.225270:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790736259.225278:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163393e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1877722816116352:0@lo:400:kworker.0 00000100:00100000:2.0:1790736259.225301:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736259.228717:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736259.228826:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816116736 00000100:00100000:1.0:1790736259.228837:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816116736 00000100:00100000:1.0:1790736259.228910:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816116480 00000100:00100000:1.0:1790736259.228913:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816116480 00000100:00100000:1.0:1790736259.228936:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790736259.228946:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816116736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736259.229012:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816116736:12345-0@lo:400:kworker.0 Request processed in 67us (3787us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736259.229020:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790736259.229038:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790736259.229044:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816116480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736259.233711:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816116224 00000100:00100000:0.0:1790736259.233727:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816116224 00000100:00080000:0.0:1790736259.233749:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790736259.233821:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816116352 00000100:00100000:0.0:1790736259.233825:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816116352 00000100:00100000:0.0:1790736259.233856:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1790736259.233866:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877722816116224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736259.234023:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736259.234054:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816116096 00000100:00100000:3.0:1790736259.234057:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816116096 00000100:00100000:3.0:1790736259.234083:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1790736259.234090:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606654c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+19:3309:x1877722816116096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736259.234139:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606654c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+19:3309:x1877722816116096:12345-0@lo:400:kworker.0 Request processed in 49us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736259.234146:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1790736259.234218:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163393f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52e04a2b-4e01-44b7-985c-7db034e22389:3309:1877722816116096:0@lo:400:kworker.0 00010000:00080000:2.0:1790736259.235530:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163393f100 x1877722816116736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790736259.235566:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163393f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816116736:0@lo:400:kworker.0 00000100:00100000:2.0:1790736259.235644:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1790736259.235657:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877722816116352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736259.235722:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877722816116352:12345-0@lo:400:kworker.0 Request processed in 70us (10420us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736259.235730:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1790736259.235766:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163393e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1877722816116352:0@lo:400:kworker.0 00000100:00100000:3.0:1790736259.236640:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163393ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1877722816116608:0@lo:400:kworker.0 00000100:00100000:3.0:1790736259.236692:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736259.237347:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816116608 00000100:00100000:2.0:1790736259.237357:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816116608 00000100:00100000:2.0:1790736259.237407:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1790736259.237416:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ad18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877722816116608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736259.237520:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ad18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877722816116608:12345-0@lo:400:kworker.0 Request processed in 105us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736259.237527:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1790736259.237717:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816116480:12345-0@lo:400:kworker.0 Request processed in 8671us (9007us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736259.237738:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790736259.237767:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163393ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1877722816116608:0@lo:400:kworker.0 00000100:00080000:1.0:1790736259.237806:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790736259.237935:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877722816116224:12345-0@lo:400:kworker.0 Request processed in 4069us (12968us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736259.237943:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1790736259.239621:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163393e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816116480:0@lo:400:kworker.0 00000100:00100000:3.0:1790736259.242722:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163393dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877722816116224:0@lo:400:kworker.0 00000100:00100000:3.0:1790736259.736005:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163393ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816116864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790736259.736085:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736259.736158:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816116864 00000100:00100000:1.0:1790736259.736167:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816116864 00000100:00100000:1.0:1790736259.736218:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790736259.736228:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ad1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816116864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790736259.736263:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790736259.747150:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ad1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816116864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 10915us (11056us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736259.747162:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1790736259.754071:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163393ca80 x1877722816116864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736275 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736259.754121:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163393ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816116864:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790736259.863769:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790736260.077052:0:11870:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 22:44:19 (1790736259) 00010000:00010000:0.0:1790736260.885450:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736261.910628:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736262.094310:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736262.094653:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797204608 00000100:00100000:2.0:1790736262.094669:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797204608 00000100:00100000:2.0:1790736262.094795:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 32 00000100:00100000:2.0:1790736262.094822:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c5e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+5:10210:x1877722797204608:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790736262.094864:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736262.094913:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe647b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526da2 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736262.095059:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931e00/0x6aae200528fe6482 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736262.095078:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611931e00/0x6aae200528fe6482 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736262.095136:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931e00/0x6aae200528fe6482 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790736262.095198:0:8114:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790736262.095203:0:8114:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790736262.095260:0:8114:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff941611931e00/0x6aae200528fe6482 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736262.095293:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe647b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526da2 expref: 7 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736262.095320:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931e00/0x6aae200528fe6482 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526da2 expref: 6 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736262.095332:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94160678a000) 00010000:00010000:2.0:1790736262.095335:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790736262.095340:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611931e00, rc 0) 00000100:00100000:2.0:1790736262.095440:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c5e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+6:10210:x1877722797204608:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 634us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736262.095750:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 32 00000100:00080000:1.0:1790736262.096067:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790736262.106936:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736262.107192:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797204736 00000100:00100000:1.0:1790736262.107206:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797204736 00000100:00100000:1.0:1790736262.107289:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 33 00000100:00100000:1.0:1790736262.107303:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+6:10211:x1877722797204736:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790736262.107335:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736262.107364:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6489 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526da9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736262.107463:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe6490 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736262.107486:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe6490 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736262.107499:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe6490 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736262.107534:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6497 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736262.107540:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6497 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736262.107547:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6497 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736262.107839:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61000/0x6aae200528fe649e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736262.107848:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61000/0x6aae200528fe649e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736262.107855:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61000/0x6aae200528fe649e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790736262.107887:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790736262.107892:0:5844:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790736262.107917:0:5844:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61000/0x6aae200528fe649e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736262.107928:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe6490 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736262.107936:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe6490 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736262.107943:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe6490 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736262.107960:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60200 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736262.107965:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe6490 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736262.107974:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe6490 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736262.107990:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94160678a000) 00010000:00010000:1.0:1790736262.107993:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736262.107999:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe6490 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736262.108006:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe6490 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736262.108031:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6497 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736262.108038:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6497 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736262.108044:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6497 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736262.108050:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736262.108053:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6497 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736262.108058:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6497 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736262.108077:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff941603253e00) 00010000:00010000:1.0:1790736262.108079:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736262.108083:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6497 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736262.108089:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6497 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736262.108203:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6489 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526da9 expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736262.108218:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61000/0x6aae200528fe649e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526da9 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736262.108225:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff941603253400) 00010000:00010000:1.0:1790736262.108228:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790736262.108231:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c61000, rc 0) 00000100:00100000:1.0:1790736262.108325:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+7:10211:x1877722797204736:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 1025us (1404us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736262.108334:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 33 00000100:00100000:0.0:1790736262.121841:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736262.122074:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797204992 00000100:00100000:2.0:1790736262.122090:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797204992 00000100:00100000:2.0:1790736262.122221:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 34 00000100:00100000:2.0:1790736262.122235:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163393ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+7:10211:x1877722797204992:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790736262.122265:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736262.122294:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe64a5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526db0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736262.122416:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe64ac lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736262.122452:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe64ac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736262.122466:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe64ac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736262.126925:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe64b3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736262.126953:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe64b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736262.126969:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe64b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736262.129788:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930000/0x6aae200528fe64ba lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736262.129812:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611930000/0x6aae200528fe64ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736262.129823:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611930000/0x6aae200528fe64ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790736262.129853:0:8114:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1790736262.130037:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe64ac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736262.130046:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe64ac lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736262.130052:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe64ac lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736262.130058:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941611930400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736262.130061:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe64ac lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736262.130068:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe64ac lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736262.130080:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff941603253400) 00010000:00010000:2.0:1790736262.130082:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790736262.130087:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe64ac lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736262.130113:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe64ac lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736262.130127:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe64b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736262.130133:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe64b3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736262.130148:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe64b3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736262.130153:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941611931a00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736262.130156:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe64b3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736262.130162:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe64b3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736262.130169:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff94160678ac00) 00010000:00010000:2.0:1790736262.130172:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790736262.130175:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe64b3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736262.130181:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe64b3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736262.135024:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe64a5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526db0 expref: 10 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736262.135052:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930000/0x6aae200528fe64ba lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526db0 expref: 9 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736262.135061:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94160678a900) 00010000:00010000:2.0:1790736262.135063:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790736262.135067:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611930000, rc 0) 00000100:00100000:2.0:1790736262.135212:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163393ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+9:10211:x1877722797204992:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 12979us (13398us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1790736262.135230:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 34 00000100:00100000:1.0:1790736262.148685:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736262.148842:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797205120 00000100:00100000:3.0:1790736262.149015:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797205120 00000100:00100000:0.0:1790736262.149229:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 35 00000100:00100000:0.0:1790736262.149246:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c5e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+9:10211:x1877722797205120:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1790736262.149427:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c5e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+9:10211:x1877722797205120:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 Request processed in 185us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736262.149435:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 35 00000040:00080000:2.0:1790736262.743983:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790736262.933946:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736263.322410:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163393dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816116992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790736263.322508:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736263.323637:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816116992 00000100:00100000:2.0:1790736263.323650:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816116992 00000100:00100000:2.0:1790736263.323730:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790736263.323744:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816116992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790736263.323791:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1790736263.324484:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790736263.324590:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816116992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 846us (2078us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736263.324600:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790736263.324722:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163393dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816116992:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790736263.957576:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790736264.191691:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736264.191748:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736264.191810:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736264.191828:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797205248 00000100:00100000:2.0:1790736264.191844:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797205248 00000100:00100000:1.0:1790736264.191929:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797205376 00000100:00100000:2.0:1790736264.191940:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 286 00000100:00100000:1.0:1790736264.191942:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797205376 00000100:00100000:2.0:1790736264.191959:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606657050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+13:2356:x1877722797205248:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1790736264.192014:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797205504 00000100:00100000:1.0:1790736264.192019:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797205504 00000100:00100000:1.0:1790736264.192055:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 131 00000100:00100000:1.0:1790736264.192069:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163393dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+9:2356:x1877722797205376:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1790736264.192167:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606657050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+13:2356:x1877722797205248:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 211us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736264.192178:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 286 00000100:00100000:1.0:1790736264.192213:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163393dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+9:2356:x1877722797205376:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 144us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736264.192224:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 131 00000100:00100000:1.0:1790736264.192247:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 132 00000100:00100000:1.0:1790736264.192255:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163393e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2356:x1877722797205504:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1790736264.192292:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163393e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2356:x1877722797205504:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 38us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736264.192300:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 132 00000100:00080000:1.0:1790736264.192326:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790736264.352906:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163393ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52e04a2b-4e01-44b7-985c-7db034e22389:3309:1877722816117120:0@lo:400:kworker.0 00000100:00100000:0.0:1790736264.353042:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736264.353771:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b6c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1877722816117632:0@lo:400:kworker.0 00000100:00100000:0.0:1790736264.353826:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736264.353876:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790736264.353884:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163393f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816117504:0@lo:400:kworker.0 00000100:00100000:0.0:1790736264.353916:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736264.353963:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163393f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877722816117248:0@lo:400:kworker.0 00000100:00100000:1.0:1790736264.356349:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816117120 00000100:00100000:1.0:1790736264.356372:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816117120 00000100:00100000:1.0:1790736264.356487:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1790736264.356499:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606657850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+19:3309:x1877722816117120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736264.356854:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606657850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+19:3309:x1877722816117120:12345-0@lo:400:kworker.0 Request processed in 357us (3812us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736264.356864:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1790736264.356928:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163393e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1877722816117376:0@lo:400:kworker.0 00000100:00100000:1.0:1790736264.357058:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736264.357427:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736264.357457:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b6c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816117760:0@lo:400:kworker.0 00000100:00100000:0.0:1790736264.358373:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736264.358701:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816117632 00000100:00100000:3.0:1790736264.358711:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816117632 00000100:00100000:3.0:1790736264.358778:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816117376 00000100:00100000:3.0:1790736264.358782:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816117376 00000100:00100000:3.0:1790736264.358798:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816117248 00000100:00100000:3.0:1790736264.358801:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816117248 00000100:00100000:3.0:1790736264.358817:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1790736264.358828:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877722816117632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736264.358898:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877722816117632:12345-0@lo:400:kworker.0 Request processed in 71us (5071us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736264.358905:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1790736264.358924:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1790736264.358930:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c5e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877722816117376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736264.358961:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c5e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877722816117376:12345-0@lo:400:kworker.0 Request processed in 31us (1987us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736264.358993:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1790736264.359006:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1790736264.359012:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160312f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877722816117248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736264.359167:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163393e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1877722816117376:0@lo:400:kworker.0 00000100:00100000:1.0:1790736264.359849:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816117504 00000100:00100000:1.0:1790736264.359862:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816117504 00000100:00100000:1.0:1790736264.359906:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816117760 00000100:00100000:1.0:1790736264.359910:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816117760 00000100:00100000:1.0:1790736264.359936:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790736264.359944:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160312ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816117504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736264.360329:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160312ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816117504:12345-0@lo:400:kworker.0 Request processed in 384us (6410us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736264.360338:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790736264.360361:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790736264.360368:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160312d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816117760:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1790736264.365217:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790736264.365231:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790736264.365324:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163393f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816117504:0@lo:400:kworker.0 00000100:00100000:2.0:1790736264.365343:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163393ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52e04a2b-4e01-44b7-985c-7db034e22389:3309:1877722816117120:0@lo:400:kworker.0 00000100:00100000:2.0:1790736264.365358:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b6c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1877722816117632:0@lo:400:kworker.0 00000100:00100000:3.0:1790736264.365404:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160312f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877722816117248:12345-0@lo:400:kworker.0 Request processed in 6386us (7971us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736264.365431:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1790736264.376216:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160312d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816117760:12345-0@lo:400:kworker.0 Request processed in 15832us (17828us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736264.376237:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790736264.376431:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163393f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877722816117248:0@lo:400:kworker.0 00010000:00080000:0.0:1790736264.376553:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94163b6c5500 x1877722816117760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790736280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790736264.376581:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b6c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816117760:0@lo:400:kworker.0 00000100:00100000:1.0:1790736264.385658:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736264.385823:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797205632 00000100:00100000:3.0:1790736264.385840:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797205632 00000100:00100000:3.0:1790736264.385930:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 36 00000100:00100000:3.0:1790736264.385944:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c5e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+9:10253:x1877722797205632:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1790736264.385995:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736264.386037:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe64c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526db7 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.386194:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9000/0x6aae200528fe64cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.386215:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9000/0x6aae200528fe64cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.386234:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9000/0x6aae200528fe64cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.386257:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe64d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.386265:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe64d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.386290:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe64d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.386850:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9000/0x6aae200528fe64cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.386863:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9000/0x6aae200528fe64cf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.386871:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9000/0x6aae200528fe64cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.386877:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c9000 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736264.386882:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9000/0x6aae200528fe64cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.386890:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9000/0x6aae200528fe64cf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.386906:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94160678a000) 00010000:00010000:3.0:1790736264.386910:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736264.386917:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9000/0x6aae200528fe64cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.386924:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9000/0x6aae200528fe64cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.386937:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe64d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.386944:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe64d6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.386957:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe64d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.386963:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c9c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736264.386966:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe64d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.387331:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe64d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.387342:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff94161505d100) 00010000:00010000:3.0:1790736264.387344:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736264.387348:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe64d6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.387355:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe64d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.387408:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe64c8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526db7 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.387431:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94160678a000) 00010000:00010000:3.0:1790736264.387434:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736264.387438:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe64c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526db7 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.387448:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c8a00, rc 0) 00000100:00100000:3.0:1790736264.388631:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c5e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+9:10253:x1877722797205632:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 2678us (2977us total) trans 0 rc 301/301 00000100:00100000:3.0:1790736264.388655:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 36 00000100:00100000:0.0:1790736264.400039:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736264.400319:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797205888 00000100:00100000:3.0:1790736264.400337:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797205888 00000100:00100000:3.0:1790736264.400404:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 37 00000100:00100000:3.0:1790736264.400431:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+9:10253:x1877722797205888:12345-192.168.203.5@tcp:36:lfs.0 00010000:00010000:3.0:1790736264.400534:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790736264.400590:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931e00/0x6aae200528fe6482 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526da2 expref: 9 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.400614:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94160678a000) 00010000:00010000:3.0:1790736264.400629:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790736264.400915:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe64dd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.400932:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe64dd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.400944:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe64dd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.400957:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe64e4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.400964:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe64e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.400970:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe64e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790736264.402251:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1790736264.402282:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe64dd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.402294:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe64dd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.402302:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe64dd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.402310:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c8a00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736264.402316:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe64dd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.402325:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe64dd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.402345:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94161505d100) 00010000:00010000:3.0:1790736264.402349:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736264.402354:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe64dd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.402361:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe64dd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790736264.402384:0:5844:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008c9441f4 reply state 000000001e086ff9 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe64e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736264.402395:0:5844:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790736264.402596:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+10:10253:x1877722797205888:12345-192.168.203.5@tcp:36:lfs.0 Request processed in 2176us (2573us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1790736264.402608:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 37 00010000:00010000:3.0:1790736264.408920:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe64e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.408971:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe64e4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.408992:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe64e4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.409000:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c9c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736264.409007:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe64e4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.409018:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe64e4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.409043:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff94161505dd00) 00010000:00010000:3.0:1790736264.409047:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736264.409053:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe64e4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.409060:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe64e4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736264.523800:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736264.525186:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797206016 00000100:00100000:2.0:1790736264.525200:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797206016 00000100:00100000:2.0:1790736264.525286:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 38 00000100:00100000:2.0:1790736264.525297:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+9:10261:x1877722797206016:12345-192.168.203.5@tcp:101:lctl.0 00010000:00010000:2.0:1790736264.525322:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736264.525348:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931800/0x6aae200528fe64eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526dbe expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736264.525416:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931e00/0x6aae200528fe64f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736264.525430:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611931e00/0x6aae200528fe64f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736264.525443:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931e00/0x6aae200528fe64f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790736264.525478:0:8114:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790736264.525482:0:8114:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790736264.525520:0:8114:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff941611931e00/0x6aae200528fe64f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736264.525545:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931800/0x6aae200528fe64eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526dbe expref: 11 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736264.525571:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931e00/0x6aae200528fe64f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526dbe expref: 10 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736264.525580:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94160678ac00) 00010000:00010000:2.0:1790736264.525583:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790736264.525586:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611931e00, rc 0) 00000100:00100000:2.0:1790736264.525657:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+10:10261:x1877722797206016:12345-192.168.203.5@tcp:101:lctl.0 Request processed in 362us (1865us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736264.525670:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 38 00000100:00100000:0.0:1790736264.620984:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736264.621350:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797206144 00000100:00100000:3.0:1790736264.621361:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797206144 00000100:00100000:3.0:1790736264.621425:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 39 00000100:00100000:3.0:1790736264.621562:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+10:10267:x1877722797206144:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:3.0:1790736264.621584:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736264.621606:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe64f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526dc5 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.621695:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6500 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.621710:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6500 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.621721:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6500 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.621735:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9000/0x6aae200528fe6507 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.621741:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9000/0x6aae200528fe6507 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.621747:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9000/0x6aae200528fe6507 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.621841:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9200/0x6aae200528fe650e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.621849:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9200/0x6aae200528fe650e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.621856:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9200/0x6aae200528fe650e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790736264.621880:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1790736264.621884:0:5844:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790736264.621922:0:5844:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9200/0x6aae200528fe650e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.621945:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6500 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.621953:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6500 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.621959:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6500 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.621965:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c8a00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736264.621969:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6500 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.621977:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6500 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.621989:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94160678ac00) 00010000:00010000:3.0:1790736264.621991:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736264.621996:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6500 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.622002:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6500 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.622014:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9000/0x6aae200528fe6507 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.622020:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9000/0x6aae200528fe6507 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.622025:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9000/0x6aae200528fe6507 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.622037:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c9000 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736264.622040:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9000/0x6aae200528fe6507 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.622045:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9000/0x6aae200528fe6507 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.622053:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff94161505dd00) 00010000:00010000:3.0:1790736264.622056:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736264.622058:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9000/0x6aae200528fe6507 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.622064:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9000/0x6aae200528fe6507 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.622119:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe64f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526dc5 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.622132:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9200/0x6aae200528fe650e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526dc5 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.622138:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94161505d100) 00010000:00010000:3.0:1790736264.622140:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790736264.622142:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c9200, rc 0) 00000100:00100000:3.0:1790736264.622207:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+11:10267:x1877722797206144:12345-192.168.203.5@tcp:101:bash.0 Request processed in 774us (1232us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736264.625579:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 39 00000100:00100000:3.0:1790736264.629419:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736264.629653:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797206400 00000100:00100000:1.0:1790736264.629663:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797206400 00000100:00100000:1.0:1790736264.629725:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 40 00000100:00100000:1.0:1790736264.629735:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+11:10267:x1877722797206400:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:1.0:1790736264.629756:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736264.629779:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6515 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526dcc expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736264.629904:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe651c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736264.629921:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe651c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736264.629932:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe651c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736264.629947:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6523 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736264.629964:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6523 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736264.629971:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6523 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790736264.631844:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1790736264.632055:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe652a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736264.632070:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe652a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736264.632081:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe652a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736264.634603:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe651c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736264.634622:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe651c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736264.634630:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe651c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736264.634636:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60600 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736264.634641:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe651c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736264.634649:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe651c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736264.634686:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94161505d100) 00010000:00010000:1.0:1790736264.634689:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736264.634694:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe651c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736264.634701:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe651c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790736264.634718:0:5843:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ab0343c6 reply state 000000007bd16d25 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6523 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736264.634728:0:5843:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790736264.634786:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6515 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526dcc expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736264.634802:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe652a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526dcc expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736264.634808:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff941603253800) 00010000:00010000:1.0:1790736264.634811:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790736264.634813:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c60a00, rc 0) 00000100:00100000:1.0:1790736264.634900:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+14:10267:x1877722797206400:12345-192.168.203.5@tcp:101:bash.0 Request processed in 5165us (5490us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1790736264.634910:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 40 00010000:00010000:2.0:1790736264.638488:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6523 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736264.638507:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6523 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736264.638516:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6523 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736264.638522:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60e00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736264.638526:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6523 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736264.638534:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6523 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736264.638549:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff941603253900) 00010000:00010000:2.0:1790736264.638552:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790736264.638565:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6523 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736264.638572:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6523 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736264.651039:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736264.653802:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797206528 00000100:00100000:0.0:1790736264.653840:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797206528 00000100:00100000:0.0:1790736264.653899:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 20 00000100:00100000:0.0:1790736264.653908:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1877722797206528:12345-192.168.203.5@tcp:8:bash.0 00010000:00080000:0.0:1790736264.653943:0:6699:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from f945944d-9086-46a2-a91c-8bc7b88e8918@192.168.203.5@tcp t0 exp 0000000000000000 cur 336 last 0 00000020:00000080:0.0:1790736264.653980:0:6699:0:(genops.c:1384:class_connect()) connect: client f945944d-9086-46a2-a91c-8bc7b88e8918, cookie 0x6aae200528fe6538 00002000:00100000:0.0:1790736264.653992:0:6699:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f945944d-9086-46a2-a91c-8bc7b88e8918/ffff941604d94800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790736264.654021:0:6699:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790736264.654325:0:6699:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790736264.654363:0:6699:0:(import.c:65:import_set_state_nolock()) ffff941604d93800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790736264.654449:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2352:x1877722797206528:12345-192.168.203.5@tcp:8:bash.0 Request processed in 539us (3420us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736264.654457:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 20 00000100:00100000:1.0:1790736264.659839:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736264.659937:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797206656 00000100:00100000:2.0:1790736264.659946:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797206656 00000100:00100000:2.0:1790736264.660021:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 21 00000100:00100000:2.0:1790736264.660031:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c5e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+6:0:x1877722797206656:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:2.0:1790736264.660069:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736264.660141:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098a7e74d/0x6aae200528fe653f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526dd3 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790736264.660172:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790736264.660191:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=336s v=(0 0) 00010000:00010000:2.0:1790736264.660195:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790736264.660204:0:6697:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098a7e74d/0x6aae200528fe653f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526dd3 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736264.660235:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000098a7e74d/0x6aae200528fe653f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526dd3 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736264.660249:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611931800, rc 0) 00000100:00100000:2.0:1790736264.660303:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c5e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+7:0:x1877722797206656:12345-192.168.203.5@tcp:101:bash.0 Request processed in 274us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736264.660310:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 21 00000100:00080000:1.0:1790736264.660454:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790736264.665834:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736264.665954:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797206784 00000100:00100000:0.0:1790736264.665963:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797206784 00000100:00100000:0.0:1790736264.666019:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 22 00000100:00100000:0.0:1790736264.666031:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+7:10267:x1877722797206784:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:0.0:1790736264.666048:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736264.666068:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003513bb39/0x6aae200528fe6546 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526dda expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736264.666138:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000098a7e74d/0x6aae200528fe653f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526dd3 expref: 8 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736264.666148:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736264.666151:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736264.666157:0:6699:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003513bb39/0x6aae200528fe6546 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526dda expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736264.666204:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000098a7e74d/0x6aae200528fe653f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0x92962417a526dd3 expref: 8 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736264.666523:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000098a7e74d/0x6aae200528fe653f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526dd3 expref: 8 pid: 6697 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736264.666540:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f7cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6699:1877722816117888:192.168.203.5@tcp:104: 00000100:00100000:0.0:1790736264.666690:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff941633c42780 going to sleep for 11 seconds 00000100:00100000:3.0:1790736264.682605:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736264.685562:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f7cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6699:1877722816117888:192.168.203.5@tcp:104: 00010000:00010000:2.0:1790736264.685598:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003513bb39/0x6aae200528fe6546 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0x92962417a526dda expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736264.685618:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941642173e00, rc 0) 00000100:00100000:2.0:1790736264.685681:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+8:10267:x1877722797206784:12345-192.168.203.5@tcp:101:bash.0 Request processed in 19653us (19856us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736264.685691:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 22 00000100:00100000:1.0:1790736264.686151:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797206912 00000100:00100000:1.0:1790736264.686522:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797206912 00010000:00010000:1.0:1790736264.686575:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000098a7e74d/0x6aae200528fe653f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526dd3 expref: 8 pid: 6697 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736264.686660:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 35 00000100:00100000:1.0:1790736264.686670:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+8:2356:x1877722797206912:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790736264.686684:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736264.686709:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000098a7e74d/0x6aae200528fe653f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526dd3 expref: 8 pid: 6697 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736264.686722:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000098a7e74d/0x6aae200528fe653f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526dd3 expref: 8 pid: 6697 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736264.686743:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098a7e74d/0x6aae200528fe653f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526dd3 expref: 8 pid: 6697 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736264.686758:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790736264.686762:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790736264.686770:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003513bb39/0x6aae200528fe6546 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0x92962417a526dda expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736264.686778:0:5829:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003513bb39/0x6aae200528fe6546 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0x92962417a526dda expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736264.686810:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003513bb39/0x6aae200528fe6546 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0x92962417a526dda expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736264.686837:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163c5e4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5829:1877722816118016:192.168.203.5@tcp:105: 00000100:00100000:1.0:1790736264.686926:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416106f3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790736264.691936:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163c5e4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5829:1877722816118016:192.168.203.5@tcp:105: 00010000:00010000:1.0:1790736264.691963:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790736264.692138:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+7:2356:x1877722797206912:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 5469us (9543us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736264.692150:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 35 00000100:00100000:2.0:1790736264.705933:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736264.706054:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797207168 00000100:00100000:3.0:1790736264.706063:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797207168 00000100:00100000:3.0:1790736264.706140:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6 00000100:00100000:3.0:1790736264.706149:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+13:10267:x1877722797207168:12345-192.168.203.5@tcp:35:bash.0 00000100:00100000:3.0:1790736264.706904:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+14:10267:x1877722797207168:12345-192.168.203.5@tcp:35:bash.0 Request processed in 753us (976us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1790736264.706914:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6 00000100:00100000:3.0:1790736264.841010:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736264.841121:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797207424 00000100:00100000:0.0:1790736264.841130:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797207424 00000100:00100000:0.0:1790736264.841186:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 41 00000100:00100000:0.0:1790736264.841196:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+14:10277:x1877722797207424:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1790736264.841226:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736264.841247:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe654d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526de1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790736264.841331:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1790736264.841448:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe654d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526de1 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736264.841463:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94160678ac00) 00010000:00010000:0.0:1790736264.841466:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790736264.841471:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe654d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526de1 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736264.841502:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941642173600, rc 0) 00000100:00100000:0.0:1790736264.841564:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+15:10277:x1877722797207424:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 369us (563us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1790736264.841571:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 41 00000100:00100000:0.0:1790736264.850890:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736264.851195:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797207680 00000100:00100000:2.0:1790736264.851205:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797207680 00000100:00100000:2.0:1790736264.851279:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 7 00000100:00100000:2.0:1790736264.851289:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+15:10277:x1877722797207680:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:2.0:1790736264.851540:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+16:10277:x1877722797207680:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 252us (659us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1790736264.851548:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 7 00000100:00100000:1.0:1790736264.853738:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f7cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816118144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790736264.853801:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736264.854199:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816118144 00000100:00100000:3.0:1790736264.854208:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816118144 00000100:00100000:3.0:1790736264.854267:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790736264.854276:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c5e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816118144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790736264.854298:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790736264.854352:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c5e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816118144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736264.854359:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790736264.854455:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f7cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816118144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790736264.972440:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736264.972626:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797207808 00000100:00100000:0.0:1790736264.972640:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797207808 00000100:00100000:0.0:1790736264.972727:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 42 00000100:00100000:0.0:1790736264.972749:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+16:10283:x1877722797207808:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1790736264.972782:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736264.972810:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe655b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526de8 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736264.972900:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6562 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736264.972920:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6562 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736264.972936:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6562 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790736264.972983:0:8114:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1790736264.972987:0:8114:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790736264.973011:0:8114:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6562 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736264.973071:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe655b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526de8 expref: 18 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736264.973156:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6562 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526de8 expref: 17 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736264.973166:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94161505d100) 00010000:00010000:0.0:1790736264.973170:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790736264.973174:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941642172200, rc 0) 00000100:00100000:0.0:1790736264.973260:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+17:10283:x1877722797207808:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 522us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736264.973268:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 42 00000100:00100000:0.0:1790736264.978490:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736264.978747:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797208064 00000100:00100000:3.0:1790736264.978760:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797208064 00000100:00100000:3.0:1790736264.978832:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 43 00000100:00100000:3.0:1790736264.978844:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+17:10283:x1877722797208064:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1790736264.978875:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736264.978901:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6569 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526def expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.979027:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9000/0x6aae200528fe6570 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.979061:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9000/0x6aae200528fe6570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.979073:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9000/0x6aae200528fe6570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790736264.979086:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1790736264.979285:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6569 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526def expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.979307:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9000/0x6aae200528fe6570 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526def expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.979318:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff941603253800) 00010000:00010000:3.0:1790736264.979321:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790736264.979326:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c9000, rc 0) 00000100:00100000:3.0:1790736264.979418:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+19:10283:x1877722797208064:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 568us (935us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1790736264.979426:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 43 00010000:00010000:0.0:1790736264.981326:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790736264.984072:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736264.984335:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797208320 00000100:00100000:0.0:1790736264.984350:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797208320 00000100:00100000:0.0:1790736264.984515:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 44 00000100:00100000:0.0:1790736264.984527:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+19:10283:x1877722797208320:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1790736264.984575:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736264.984601:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe657e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526df6 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736264.984726:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe6585 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736264.984753:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe6585 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736264.984779:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe6585 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790736264.984794:0:8114:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1790736264.984959:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe657e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526df6 expref: 22 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736264.984983:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe6585 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526df6 expref: 21 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736264.984993:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff941603253800) 00010000:00010000:0.0:1790736264.984996:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790736264.985000:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941642173600, rc 0) 00000100:00100000:0.0:1790736264.985085:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+21:10283:x1877722797208320:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 559us (1027us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1790736264.985153:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 44 00000100:00100000:2.0:1790736264.987999:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736264.988154:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797208448 00000100:00100000:3.0:1790736264.988166:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797208448 00000100:00100000:3.0:1790736264.988241:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2 00000100:00100000:3.0:1790736264.988252:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+21:2353:x1877722797208448:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790736264.988273:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790736264.988302:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9000/0x6aae200528fe6570 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526def expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736264.988351:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff941603253800) 00010000:00010000:3.0:1790736264.988357:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790736264.988432:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+20:2353:x1877722797208448:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 181us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736264.988440:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2 00000100:00100000:3.0:1790736264.995458:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736264.995669:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797208576 00000100:00100000:2.0:1790736264.995688:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797208576 00000100:00100000:2.0:1790736264.995779:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 23 00000100:00100000:2.0:1790736264.995791:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+7:2355:x1877722797208576:12345-192.168.203.5@tcp:1:lfs.0 00010000:00010000:2.0:1790736264.995860:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2cec49c/0x6aae200528fe6593 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736264.995889:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003513bb39/0x6aae200528fe6546 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0x92962417a526dda expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736264.995898:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1790736264.995903:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790736264.995909:0:6697:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2cec49c/0x6aae200528fe6593 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736264.995953:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003513bb39/0x6aae200528fe6546 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.5@tcp remote: 0x92962417a526dda expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736264.995991:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003513bb39/0x6aae200528fe6546 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a526dda expref: 7 pid: 6699 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736264.996009:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163380e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6697:1877722816118272:192.168.203.5@tcp:104: 00000100:00100000:2.0:1790736264.996252:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff94161871af00 going to sleep for 11 seconds 00000100:00100000:1.0:1790736264.999980:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163380e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6697:1877722816118272:192.168.203.5@tcp:104: 00010000:00010000:1.0:1790736265.000029:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b2cec49c/0x6aae200528fe6593 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736265.000055:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736265.004305:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797208704 00000100:00100000:3.0:1790736265.004329:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797208704 00002000:00100000:3.0:1790736265.004386:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff94163380e300 x1877722797208704/t0(0) o4->f945944d-9086-46a2-a91c-8bc7b88e8918@192.168.203.5@tcp:96/0 lens 504/0 e 0 to 0 dl 1790736276 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790736265.004398:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94163380e300 with x1877722797208704 ext(0->12) 00010000:00010000:3.0:1790736265.004410:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003513bb39/0x6aae200528fe6546 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a526dda expref: 8 pid: 6699 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.004428:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003513bb39/0x6aae200528fe6546 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a526dda expref: 8 pid: 6699 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790736265.004435:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff94163380e300 00000100:00100000:3.0:1790736265.004475:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 0 00000100:00100000:3.0:1790736265.004494:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+8:2355:x1877722797208704:12345-192.168.203.5@tcp:4:lfs.0 00000001:00100000:0.0:1790736265.064671:0:7658:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f945944d-9086-46a2-a91c-8bc7b88e8918 00000100:00100000:3.0:1790736265.068532:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+9:2355:x1877722797208704:12345-192.168.203.5@tcp:4:lfs.0 Request processed in 64019us (68488us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1790736265.068569:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 0 00002000:00100000:3.0:1790736265.068588:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff94163380e300 x1877722797208704/t4294967299(0) o4->f945944d-9086-46a2-a91c-8bc7b88e8918@192.168.203.5@tcp:96/0 lens 504/448 e 0 to 0 dl 1790736276 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790736265.068615:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94163380e300 with x1877722797208704 ext(0->12) 00010000:00010000:3.0:1790736265.068631:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003513bb39/0x6aae200528fe6546 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a526dda expref: 9 pid: 6699 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.068660:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003513bb39/0x6aae200528fe6546 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a526dda expref: 9 pid: 6699 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790736265.068669:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff94163380e300 00000100:00100000:0.0:1790736265.075686:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736265.075831:0:8527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797208832 00000100:00100000:1.0:1790736265.075845:0:8527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797208832 00010000:00010000:1.0:1790736265.075917:0:8527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003513bb39/0x6aae200528fe6546 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a526dda expref: 9 pid: 6699 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736265.075975:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 36 00000100:00100000:1.0:1790736265.075987:0:8527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c521c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+9:2353:x1877722797208832:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790736265.076005:0:8527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1790736265.076030:0:8527:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1790736265.076033:0:8527:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1790736265 00002000:00010000:1.0:1790736265.076043:0:8527:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1790736265 00002000:00010000:1.0:1790736265.076046:0:8527:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1790736265 00010000:00010000:1.0:1790736265.076054:0:8527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003513bb39/0x6aae200528fe6546 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a526dda expref: 9 pid: 6699 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736265.076070:0:8527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003513bb39/0x6aae200528fe6546 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a526dda expref: 9 pid: 6699 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736265.076125:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003513bb39/0x6aae200528fe6546 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.5@tcp remote: 0x92962417a526dda expref: 9 pid: 6699 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736265.077315:0:8527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790736265.077326:0:8527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790736265.077336:0:8527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b2cec49c/0x6aae200528fe6593 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736265.077351:0:8527:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2cec49c/0x6aae200528fe6593 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736265.077586:0:8527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790736265.077682:0:8527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c521c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+8:2353:x1877722797208832:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 1691us (2006us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736265.077697:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 36 00010000:00010000:1.0:1790736265.078817:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b2cec49c/0x6aae200528fe6593 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736265.078838:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2cec49c/0x6aae200528fe6593 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736265.078893:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2cec49c/0x6aae200528fe6593 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736265.078925:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2cec49c/0x6aae200528fe6593 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736265.078933:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2cec49c/0x6aae200528fe6593 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736265.078938:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941611931600 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:1.0:1790736265.078942:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2cec49c/0x6aae200528fe6593 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736265.078951:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2cec49c/0x6aae200528fe6593 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736265.078974:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2cec49c/0x6aae200528fe6593 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736265.078982:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2cec49c/0x6aae200528fe6593 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736265.080049:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+7:2355:x1877722797208576:12345-192.168.203.5@tcp:1:lfs.0 Request processed in 83343us (83690us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736265.080075:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 23 00000100:00100000:0.0:1790736265.082512:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736265.084046:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797209088 00000100:00100000:2.0:1790736265.084064:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797209088 00000100:00100000:2.0:1790736265.084431:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 8 00000100:00100000:2.0:1790736265.084445:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+20:10283:x1877722797209088:12345-192.168.203.5@tcp:35:lfs.0 00000004:00010000:2.0:1790736265.084537:0:5847:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe6585 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526df6 expref: 20 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790736265.084964:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1790736265.085028:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1790736265.086688:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1790736265.086816:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe659a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736265.086844:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe652a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526dcc expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736265.086855:0:5847:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe659a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736265.086905:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe652a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0x92962417a526dcc expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736265.086943:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe652a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526dcc expref: 24 pid: 5843 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736265.086962:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163380ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5847:1877722816118400:192.168.203.5@tcp:104: 00000100:00100000:2.0:1790736265.088088:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff94161871a900 going to sleep for 11 seconds 00000100:00100000:1.0:1790736265.095507:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736265.095601:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797209216 00000100:00100000:3.0:1790736265.095614:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797209216 00010000:00010000:3.0:1790736265.095668:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe652a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526dcc expref: 25 pid: 5843 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736265.095732:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 37 00000100:00100000:3.0:1790736265.095791:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c5e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+25:2355:x1877722797209216:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790736265.095812:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790736265.095820:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe652a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526dcc expref: 25 pid: 5843 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.095840:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe652a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526dcc expref: 25 pid: 5843 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.095868:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff941603253800) 00010000:00010000:3.0:1790736265.095875:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe659a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.095904:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe659a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.095913:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe659a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.095955:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790736265.096030:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c5e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+25:2355:x1877722797209216:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 288us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736265.096038:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 37 00010000:00010000:0.0:1790736265.096565:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe652a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526dcc expref: 24 pid: 5843 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736265.096588:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163380ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5847:1877722816118400:192.168.203.5@tcp:104: 00010000:00010000:0.0:1790736265.096628:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe659a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736265.096639:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe659a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736265.096645:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe659a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790736265.096838:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1790736265.097263:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1790736265.097432:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163c520e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1877722816118528:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790736265.097793:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736265.098223:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607d786c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790736265.106437:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816118528 00000100:00100000:1.0:1790736265.106459:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816118528 00000100:00100000:1.0:1790736265.106532:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790736265.106543:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c522680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1877722816118528:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790736265.106690:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c522680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1877722816118528:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 149us (8906us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736265.106698:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790736265.106819:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163c520e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1877722816118528:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1790736265.107507:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1790736265.107613:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163c520e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1877722816118656:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790736265.107670:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736265.107703:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607d78600 going to sleep for 11 seconds 00000100:00100000:3.0:1790736265.107776:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816118656 00000100:00100000:3.0:1790736265.107792:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816118656 00000100:00100000:3.0:1790736265.107851:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790736265.107862:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5847:x1877722816118656:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790736265.111498:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5847:x1877722816118656:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 3628us (3818us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1790736265.111522:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790736265.111671:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163c520e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1877722816118656:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1790736265.111776:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1790736265.112004:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe659a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736265.112015:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe659a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736265.112023:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe659a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736265.112030:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941611931c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736265.112035:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe659a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736265.112042:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe659a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736265.112059:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff941603253800) 00010000:00010000:2.0:1790736265.112062:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1790736265.112066:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe659a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736265.112192:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe659a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790736265.112415:0:5847:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1790736265.114618:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1790736265.114641:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 337125546695ns, next at 338125542059ns, rc = 0 00000001:00080000:2.0:1790736265.114659:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1790736265.114732:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff941603253800) 00010000:00010000:2.0:1790736265.114737:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790736265.114751:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe6585 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526df6 expref: 28 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736265.114933:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+27:10283:x1877722797209088:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 30490us (32434us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1790736265.114942:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 8 00000020:00080000:2.0:1790736265.114948:0:5847:0:(tgt_main.c:787:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1790736265.127911:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736265.128027:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797209344 00000100:00100000:3.0:1790736265.128046:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797209344 00000100:00100000:3.0:1790736265.128163:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 45 00000100:00100000:3.0:1790736265.128174:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+27:10283:x1877722797209344:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1790736265.128199:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736265.128227:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9000/0x6aae200528fe65a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526dfd expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.128296:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9000/0x6aae200528fe65a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526dfd expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.128313:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9000/0x6aae200528fe65a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526dfd expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.128364:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94161505da00) 00010000:00010000:3.0:1790736265.128367:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790736265.128370:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c9000, rc 0) 00000100:00100000:3.0:1790736265.128449:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+28:10283:x1877722797209344:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 277us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736265.128456:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 45 00000100:00100000:1.0:1790736265.132376:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736265.132773:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797209600 00000100:00100000:3.0:1790736265.132789:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797209600 00000100:00100000:3.0:1790736265.132863:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 9 00000100:00100000:3.0:1790736265.132876:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416114ed850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+28:10283:x1877722797209600:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:2.0:1790736265.133417:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416114ed850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+29:10283:x1877722797209600:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 532us (1045us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1790736265.133430:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 9 00000100:00100000:1.0:1790736265.238377:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736265.238900:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797209856 00000100:00100000:3.0:1790736265.238916:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797209856 00000100:00100000:3.0:1790736265.239005:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 46 00000100:00100000:3.0:1790736265.239016:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c5e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+29:10293:x1877722797209856:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1790736265.239064:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736265.239138:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe65a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526e04 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790736265.239261:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1790736265.239538:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe65a8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e04 expref: 31 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.239574:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94160678ac00) 00010000:00010000:3.0:1790736265.239579:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790736265.239586:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe65a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e04 expref: 31 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.239625:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c9c00, rc 0) 00000100:00100000:3.0:1790736265.239722:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c5e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+30:10293:x1877722797209856:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 708us (1363us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1790736265.239731:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 46 00000100:00100000:3.0:1790736265.243021:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736265.243782:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797209984 00000100:00100000:1.0:1790736265.243804:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797209984 00000100:00100000:1.0:1790736265.243897:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 47 00000100:00100000:1.0:1790736265.243909:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+30:10293:x1877722797209984:12345-192.168.203.5@tcp:34:lfs.0 00010000:00010000:1.0:1790736265.244822:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe65b6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736265.244848:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe65b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736265.244860:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe65b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736265.244881:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe65bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736265.244889:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe65bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736265.244897:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe65bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736265.245022:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe65c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736265.245344:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe65c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736265.245352:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe65c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790736265.245581:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe65c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736265.245598:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe65b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736265.245606:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe65b6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736265.245614:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe65b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736265.245621:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c61c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736265.245625:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe65b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736265.245634:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe65b6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736265.245648:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94161505d100) 00010000:00010000:1.0:1790736265.245652:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736265.245657:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe65b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736265.245663:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe65b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736265.245686:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe65bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736265.245692:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe65bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736265.245699:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe65bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736265.245704:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c61800 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736265.245707:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe65bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736265.245713:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe65bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736265.245721:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff941603253100) 00010000:00010000:1.0:1790736265.245723:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736265.245726:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe65bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736265.245733:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe65bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736265.245823:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe65c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736265.245830:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe65c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736265.245836:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe65c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736265.245848:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c61400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736265.245852:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe65c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736265.245858:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe65c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736265.245867:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94161505da00) 00010000:00010000:1.0:1790736265.245869:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736265.245872:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe65c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736265.245878:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe65c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736265.246049:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+30:10293:x1877722797209984:12345-192.168.203.5@tcp:34:lfs.0 Request processed in 2137us (3037us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736265.246061:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 47 00000100:00100000:1.0:1790736265.249436:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736265.249676:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797210240 00000100:00100000:2.0:1790736265.249694:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797210240 00000100:00100000:2.0:1790736265.249764:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 10 00000100:00100000:2.0:1790736265.249775:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c5e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+30:10293:x1877722797210240:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:2.0:1790736265.250138:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c5e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+31:10293:x1877722797210240:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 356us (718us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1790736265.250148:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 10 00000100:00100000:2.0:1790736265.288452:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736265.288567:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797210496 00000100:00100000:3.0:1790736265.288583:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797210496 00000100:00100000:3.0:1790736265.288661:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 48 00000100:00100000:3.0:1790736265.288674:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+31:10296:x1877722797210496:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1790736265.288724:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736265.288752:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe65cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526e0b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.288856:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe65d2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.288873:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe65d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.288887:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe65d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.288906:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe65d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.288913:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe65d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.288944:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe65d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.289222:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe65e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.289233:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe65e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.289241:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe65e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790736265.289253:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1790736265.289393:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe65d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.289404:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe65d2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.289411:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe65d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.289418:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c8a00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736265.289424:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe65d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.289433:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe65d2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.289447:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94161505d100) 00010000:00010000:3.0:1790736265.289450:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736265.289465:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe65d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.289472:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe65d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.289490:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe65d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.289497:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe65d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.289504:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe65d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.289509:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c9400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736265.289513:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe65d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.289519:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe65d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.289528:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94161505dd00) 00010000:00010000:3.0:1790736265.289530:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736265.289533:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe65d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.289540:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe65d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.289608:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe65cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e0b expref: 34 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.289637:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe65e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e0b expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.289646:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94161505da00) 00010000:00010000:3.0:1790736265.289648:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790736265.289651:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c8400, rc 0) 00000100:00100000:3.0:1790736265.289963:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+33:10296:x1877722797210496:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1290us (1527us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1790736265.289975:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 48 00000100:00100000:1.0:1790736265.295904:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736265.296020:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797210624 00000100:00100000:3.0:1790736265.296034:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797210624 00000100:00100000:3.0:1790736265.296543:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 49 00000100:00100000:3.0:1790736265.296565:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c5e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+33:10296:x1877722797210624:12345-192.168.203.5@tcp:54:lfs.0 00010000:00010000:3.0:1790736265.296658:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe65ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.296681:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe65ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.296695:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe65ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.296724:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe65ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.296732:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe65ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.296761:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe65ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.296767:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c9c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736265.296772:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe65ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.296780:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe65ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.296793:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94161505da00) 00010000:00010000:3.0:1790736265.296796:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790736265.296800:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe65ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.296807:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe65ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736265.296904:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c5e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+33:10296:x1877722797210624:12345-192.168.203.5@tcp:54:lfs.0 Request processed in 341us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736265.296913:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 49 00000100:00100000:1.0:1790736265.302784:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736265.302890:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797210880 00000100:00100000:2.0:1790736265.302904:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797210880 00000100:00100000:2.0:1790736265.302977:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 11 00000100:00100000:2.0:1790736265.302988:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c5e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+33:10296:x1877722797210880:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:2.0:1790736265.303315:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c5e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+34:10296:x1877722797210880:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 328us (546us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1790736265.303324:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 11 00000001:00080000:1.0:1790736265.503693:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967323 is committed 00000020:00080000:1.0:1790736265.503718:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff941607d786c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1790736265.503724:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94162f100b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff941607d78e40 00000020:00080000:1.0:1790736265.503729:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94162f100000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff941603095c00 00000020:00080000:2.0:1790736265.503843:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1790736265.504087:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000001:00080000:0.0:1790736265.518174:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967330 is committed 00000004:00080000:0.0:1790736265.518202:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1790736265.518731:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163380d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816118784:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1790736265.518823:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736265.519546:0:8632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816118784 00000100:00100000:3.0:1790736265.519573:0:8632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816118784 00000100:00100000:3.0:1790736265.519639:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790736265.519649:0:8632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c5e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1877722816118784:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1790736265.519682:0:8632:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1790736265.519721:0:8632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6abc7789, atime: 0x6abc7789, ctime: 0x6abc7789, blocks: 0x1 00010000:00010000:3.0:1790736265.519731:0:8632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe88ea5f/0x6aae200528fe65f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.519761:0:8632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=337s v=(0 0) 00010000:00010000:3.0:1790736265.519766:0:8632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790736265.519774:0:8632:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe88ea5f/0x6aae200528fe65f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.519789:0:8632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe88ea5f/0x6aae200528fe65f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.519800:0:8632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe88ea5f/0x6aae200528fe65f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.519809:0:8632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe88ea5f/0x6aae200528fe65f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.519834:0:8632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790736265.521006:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790736265.521019:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe88ea5f/0x6aae200528fe65f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736265.521055:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c9400 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:0.0:1790736265.521060:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe88ea5f/0x6aae200528fe65f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736265.521079:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe88ea5f/0x6aae200528fe65f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736265.521137:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe88ea5f/0x6aae200528fe65f5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736265.521147:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe88ea5f/0x6aae200528fe65f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736265.521179:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736265.521181:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736265.521183:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736265.530149:0:8632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c5e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3308:x1877722816118784:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10486us (11311us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1790736265.530166:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:0.0:1790736265.532612:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94163380d880/2, rc 0, transno 4294967301 00000100:00100000:0.0:1790736265.532633:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163380d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816118784:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1790736265.590714:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736265.590889:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797211136 00000100:00100000:3.0:1790736265.590905:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797211136 00000100:00100000:3.0:1790736265.591000:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 50 00000100:00100000:3.0:1790736265.591013:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+12:10327:x1877722797211136:12345-192.168.203.5@tcp:101:cat.0 00010000:00010000:3.0:1790736265.591347:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736265.591379:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe65fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526e12 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.591582:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6603 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.591605:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6603 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.591620:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6603 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790736265.591636:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1790736265.592558:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe65fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e12 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.592641:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6603 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e12 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.592652:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94161505da00) 00010000:00010000:3.0:1790736265.592656:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790736265.592660:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c8a00, rc 0) 00000100:00100000:2.0:1790736265.592908:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+14:10327:x1877722797211136:12345-192.168.203.5@tcp:101:cat.0 Request processed in 1894us (2205us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1790736265.592919:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 50 00000100:00100000:3.0:1790736265.597856:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736265.598397:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797211392 00000100:00100000:2.0:1790736265.598416:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797211392 00000100:00100000:2.0:1790736265.598513:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 12 00000100:00100000:2.0:1790736265.598526:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+14:10327:x1877722797211392:12345-192.168.203.5@tcp:35:cat.0 00000100:00100000:2.0:1790736265.600353:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+15:10327:x1877722797211392:12345-192.168.203.5@tcp:35:cat.0 Request processed in 1816us (2500us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1790736265.600369:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 12 00000100:00100000:0.0:1790736265.603298:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736265.607348:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797211520 00000100:00100000:2.0:1790736265.607372:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797211520 00000100:00100000:2.0:1790736265.607598:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3 00000100:00100000:2.0:1790736265.607613:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160557c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+15:2353:x1877722797211520:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790736265.607639:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790736265.607702:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6603 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e12 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736265.607732:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94161505da00) 00010000:00010000:2.0:1790736265.607738:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790736265.607838:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160557c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+14:2353:x1877722797211520:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 229us (4555us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736265.607846:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3 00000100:00100000:3.0:1790736265.692540:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736265.692642:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797211776 00000100:00100000:0.0:1790736265.692657:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797211776 00000100:00100000:0.0:1790736265.692737:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 51 00000100:00100000:0.0:1790736265.692750:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+14:10333:x1877722797211776:12345-192.168.203.5@tcp:101:dd.0 00010000:00010000:0.0:1790736265.692797:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736265.692802:0:8114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790736265.692853:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6562 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526de8 expref: 14 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736265.692891:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94161505d100) 00010000:00010000:0.0:1790736265.692897:0:8114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790736265.692915:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe6611 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526e19 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736265.693053:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6618 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736265.693068:0:8114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe65e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e0b expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736265.693078:0:8114:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6618 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736265.693187:0:8114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe65e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e0b expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736265.693204:0:8114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe65e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e0b expref: 14 pid: 5843 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736265.693222:0:8114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163c521f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8114:1877722816118912:192.168.203.5@tcp:104: 00000100:00100000:0.0:1790736265.693362:0:8114:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607d78600 going to sleep for 11 seconds 00000100:00100000:0.0:1790736265.700985:0:8114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163c521f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8114:1877722816118912:192.168.203.5@tcp:104: 00010000:00010000:0.0:1790736265.701059:0:8114:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6618 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736265.702904:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736265.704995:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797211904 00000100:00100000:3.0:1790736265.705018:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797211904 00010000:00010000:3.0:1790736265.705155:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe65e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e0b expref: 15 pid: 5843 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736265.705225:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 38 00000100:00100000:3.0:1790736265.705237:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c5e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+15:2356:x1877722797211904:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790736265.705280:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790736265.705288:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe65e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e0b expref: 15 pid: 5843 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.705304:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe65e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e0b expref: 15 pid: 5843 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.705334:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe65e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e0b expref: 15 pid: 5843 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.705356:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94161505da00) 00010000:00010000:3.0:1790736265.705361:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6618 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.705372:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6618 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.706559:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6618 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.706917:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790736265.707018:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c5e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+14:2356:x1877722797211904:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 1779us (4124us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736265.707031:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 38 00010000:00010000:0.0:1790736265.707089:0:8114:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6618 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736265.707116:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6618 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790736265.707145:0:8114:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1790736265.707736:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe6611 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e19 expref: 15 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736265.707766:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6618 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e19 expref: 14 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736265.707776:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94161505da00) 00010000:00010000:0.0:1790736265.707778:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790736265.707781:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941642173e00, rc 0) 00000100:00100000:0.0:1790736265.707837:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+14:10333:x1877722797211776:12345-192.168.203.5@tcp:101:dd.0 Request processed in 15090us (15318us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1790736265.707846:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 51 00000100:00100000:1.0:1790736265.712586:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736265.712836:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797212160 00000100:00100000:2.0:1790736265.712850:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797212160 00000100:00100000:2.0:1790736265.712930:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 52 00000100:00100000:2.0:1790736265.712943:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c5e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+14:10333:x1877722797212160:12345-192.168.203.5@tcp:36:dd.0 00010000:00010000:2.0:1790736265.713366:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6626 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736265.713389:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6626 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736265.713522:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6626 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790736265.713659:0:5843:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1790736265.713689:0:5843:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000344c5d63 reply state 00000000cc7c0600 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6626 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736265.713698:0:5843:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790736265.713869:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c5e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+17:10333:x1877722797212160:12345-192.168.203.5@tcp:36:dd.0 Request processed in 926us (1303us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1790736265.713877:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 52 00000020:00080000:2.0:1790736265.713884:0:5843:0:(tgt_main.c:787:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790736265.720236:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6626 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.720258:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6626 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.720289:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6626 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.720295:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941611930400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736265.720301:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6626 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.720310:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6626 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.720331:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94161505da00) 00010000:00010000:3.0:1790736265.720335:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736265.720342:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6626 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736265.720349:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6626 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736266.004486:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736266.005077:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797212288 00000100:00100000:3.0:1790736266.005158:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797212288 00000100:00100000:3.0:1790736266.005255:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 53 00000100:00100000:3.0:1790736266.005268:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c5e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+16:10347:x1877722797212288:12345-192.168.203.5@tcp:101:stat.0 00010000:00010000:3.0:1790736266.005302:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736266.005330:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe662d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526e20 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.005423:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6634 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.005441:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6634 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.005473:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6634 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.005491:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe663b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.005498:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe663b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.005505:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe663b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.005841:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6642 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.005854:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6618 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e19 expref: 17 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.005862:0:5845:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6642 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.005903:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6618 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e19 expref: 17 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.005919:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6618 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e19 expref: 17 pid: 8114 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736266.005934:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fad7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1877722816119040:192.168.203.5@tcp:104: 00000100:00100000:3.0:1790736266.006076:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416338f7c00 going to sleep for 11 seconds 00010000:00010000:0.0:1790736266.006233:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790736266.006782:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790736266.009220:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736266.009353:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797212544 00000100:00100000:0.0:1790736266.009367:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797212544 00000100:00100000:0.0:1790736266.009452:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 13 00000100:00100000:0.0:1790736266.009464:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+18:5592:x1877722797212544:12345-192.168.203.5@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1790736266.009987:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+19:5592:x1877722797212544:12345-192.168.203.5@tcp:35:ldlm_bl.0 Request processed in 522us (781us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1790736266.009998:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 13 00000100:00100000:3.0:1790736266.010986:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fad7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1877722816119040:192.168.203.5@tcp:104: 00010000:00010000:3.0:1790736266.011046:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6642 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736266.012401:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736266.012712:0:8527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797212672 00000100:00100000:0.0:1790736266.012724:0:8527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797212672 00010000:00010000:0.0:1790736266.012776:0:8527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6618 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e19 expref: 19 pid: 8114 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736266.012822:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 39 00000100:00100000:0.0:1790736266.012831:0:8527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+19:2356:x1877722797212672:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790736266.012850:0:8527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790736266.012857:0:8527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6618 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e19 expref: 19 pid: 8114 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.012871:0:8527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6618 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e19 expref: 19 pid: 8114 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.012896:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6618 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e19 expref: 19 pid: 8114 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.012918:0:8527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94161505da00) 00010000:00010000:0.0:1790736266.012924:0:8527:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6642 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.012936:0:8527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6642 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.012945:0:8527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6642 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.012976:0:8527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790736266.013249:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6642 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.013258:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6642 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790736266.013317:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1790736266.013323:0:5845:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790736266.013388:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6642 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.013412:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6642 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.013423:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6634 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.013432:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6634 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.013439:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6634 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.013446:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c9c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736266.013451:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6634 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.013459:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6634 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.013489:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94161505d100) 00010000:00010000:3.0:1790736266.013491:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736266.013497:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6634 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.013503:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6634 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.013514:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe663b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.013521:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe663b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.013527:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe663b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.013532:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c9a00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736266.013535:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe663b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.013540:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe663b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.013557:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94161505de00) 00010000:00010000:3.0:1790736266.013559:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736266.013562:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe663b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.013568:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe663b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.013623:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe662d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e20 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.013638:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6642 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e20 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.013646:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94161505da00) 00010000:00010000:3.0:1790736266.013648:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790736266.013651:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c8000, rc 0) 00000100:00100000:0.0:1790736266.013753:0:8527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+18:2356:x1877722797212672:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 921us (1361us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736266.013770:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 39 00000100:00100000:3.0:1790736266.014321:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c5e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+17:10347:x1877722797212288:12345-192.168.203.5@tcp:101:stat.0 Request processed in 9053us (9847us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736266.014329:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 53 00000100:00100000:2.0:1790736266.087334:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736266.087841:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797212928 00000100:00100000:0.0:1790736266.087855:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797212928 00000100:00100000:0.0:1790736266.087934:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 54 00000100:00100000:0.0:1790736266.087948:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+17:10353:x1877722797212928:12345-192.168.203.5@tcp:36:truncate.0 00010000:00010000:0.0:1790736266.088028:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790736266.088064:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6642 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e20 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.088089:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94161505da00) 00010000:00010000:0.0:1790736266.088210:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790736266.088726:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6649 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.088746:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6649 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.088756:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6649 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790736266.088812:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1790736266.088844:0:5844:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000776fbe8a reply state 000000001f35d2b8 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6649 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736266.088854:0:5844:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790736266.089776:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+19:10353:x1877722797212928:12345-192.168.203.5@tcp:36:truncate.0 Request processed in 1819us (2442us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1790736266.089789:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 54 00000020:00080000:0.0:1790736266.089823:0:5844:0:(tgt_main.c:787:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790736266.095742:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6649 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.095768:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6649 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.095777:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6649 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.095785:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642173e00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736266.095792:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6649 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.095800:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6649 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.095822:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94161505da00) 00010000:00010000:2.0:1790736266.095826:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790736266.095832:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6649 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.095839:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6649 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736266.206496:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736266.206742:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797213056 00000100:00100000:0.0:1790736266.206757:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797213056 00000100:00100000:0.0:1790736266.206843:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 55 00000100:00100000:0.0:1790736266.206855:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+18:10367:x1877722797213056:12345-192.168.203.5@tcp:101:stat.0 00010000:00010000:0.0:1790736266.206895:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736266.206920:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe6650 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526e27 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.207006:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6657 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.207024:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6657 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.207042:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6657 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.207060:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe665e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.207068:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe665e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.207073:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe665e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.207458:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6665 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.207468:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6665 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.207485:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6665 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790736266.207534:0:8114:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1790736266.207540:0:8114:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790736266.208289:0:8114:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6665 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.208310:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6665 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.208320:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6657 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.208329:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6657 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.208337:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6657 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.208356:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642172200 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736266.208361:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6657 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.208370:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6657 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.208386:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94161505d100) 00010000:00010000:0.0:1790736266.208389:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736266.208395:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6657 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.208710:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6657 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.208732:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe665e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.208738:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe665e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.208744:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe665e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.208749:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642173200 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736266.208752:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe665e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.208758:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe665e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.208766:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff941605242100) 00010000:00010000:0.0:1790736266.208768:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736266.208771:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe665e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.208777:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe665e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.208831:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe6650 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e27 expref: 20 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.208845:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6665 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e27 expref: 19 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.208858:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94161505da00) 00010000:00010000:0.0:1790736266.208861:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790736266.208863:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941642173e00, rc 0) 00000100:00100000:0.0:1790736266.209141:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+19:10367:x1877722797213056:12345-192.168.203.5@tcp:101:stat.0 Request processed in 2238us (2608us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736266.209153:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 55 00000100:00100000:1.0:1790736266.294810:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736266.294929:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797213312 00000100:00100000:2.0:1790736266.294942:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797213312 00000100:00100000:2.0:1790736266.295021:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 56 00000100:00100000:2.0:1790736266.295034:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c5e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+19:10378:x1877722797213312:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1790736266.295087:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736266.295153:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe666c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526e2e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790736266.295295:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1790736266.295787:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe666c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e2e expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.295806:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94160678ac00) 00010000:00010000:2.0:1790736266.295810:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790736266.295816:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe666c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e2e expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.295834:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611930400, rc 0) 00000100:00100000:2.0:1790736266.295928:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c5e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+20:10378:x1877722797213312:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 897us (1134us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1790736266.295937:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 56 00000100:00100000:2.0:1790736266.299435:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736266.299576:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797213568 00000100:00100000:0.0:1790736266.299595:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797213568 00000100:00100000:0.0:1790736266.299681:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 14 00000100:00100000:0.0:1790736266.299693:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+20:10378:x1877722797213568:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:0.0:1790736266.300076:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+21:10378:x1877722797213568:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 384us (659us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1790736266.300086:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 14 00000100:00100000:1.0:1790736266.374561:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736266.374839:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797213824 00000100:00100000:3.0:1790736266.374855:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797213824 00000100:00100000:3.0:1790736266.374929:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 57 00000100:00100000:3.0:1790736266.374941:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c5e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+21:10384:x1877722797213824:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:3.0:1790736266.374984:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736266.375014:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe667a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526e35 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.375189:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6681 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.375207:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6665 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e27 expref: 22 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.375219:0:5845:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6681 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.375282:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6665 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e27 expref: 22 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.375298:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6665 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e27 expref: 22 pid: 8114 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736266.375317:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fad7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1877722816119168:192.168.203.5@tcp:104: 00000100:00100000:3.0:1790736266.375459:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416338f7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790736266.389778:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736266.389929:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797213952 00000100:00100000:0.0:1790736266.389943:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797213952 00010000:00010000:0.0:1790736266.390005:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6665 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e27 expref: 23 pid: 8114 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736266.390059:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 40 00000100:00100000:0.0:1790736266.390070:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+23:2355:x1877722797213952:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790736266.390090:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790736266.390119:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6665 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e27 expref: 23 pid: 8114 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.390134:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6665 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e27 expref: 23 pid: 8114 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.390183:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94161505da00) 00010000:00010000:0.0:1790736266.390189:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6681 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.390200:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6681 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.390208:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6681 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.390232:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790736266.390305:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+23:2355:x1877722797213952:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 236us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736266.390314:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 40 00010000:00010000:3.0:1790736266.390452:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6665 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e27 expref: 22 pid: 8114 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736266.390475:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fad7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1877722816119168:192.168.203.5@tcp:104: 00010000:00010000:3.0:1790736266.390517:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6681 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.390528:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6681 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.390535:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6681 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790736266.390575:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1790736266.390784:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe667a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e35 expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.390802:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6681 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e35 expref: 22 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.390826:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94161505da00) 00010000:00010000:3.0:1790736266.390828:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790736266.390831:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c9a00, rc 0) 00000100:00100000:3.0:1790736266.390865:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c5e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+22:10384:x1877722797213824:12345-192.168.203.5@tcp:101:bash.0 Request processed in 15926us (16329us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1790736266.390872:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 57 00000100:00100000:2.0:1790736266.396609:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736266.396957:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797214208 00000100:00100000:0.0:1790736266.396985:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797214208 00000100:00100000:0.0:1790736266.397071:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 58 00000100:00100000:0.0:1790736266.397085:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+22:10384:x1877722797214208:12345-192.168.203.5@tcp:36:bash.0 00010000:00010000:0.0:1790736266.397588:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe668f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.397613:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe668f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.397627:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe668f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790736266.397697:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1790736266.397729:0:5844:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000065fdd6ee reply state 00000000c1153768 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe668f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736266.397762:0:5844:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790736266.397921:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+25:10384:x1877722797214208:12345-192.168.203.5@tcp:36:bash.0 Request processed in 835us (1327us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1790736266.397930:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 58 00000020:00080000:0.0:1790736266.397938:0:5844:0:(tgt_main.c:787:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790736266.400160:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe668f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.400187:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe668f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.400194:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe668f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.400201:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642173600 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736266.400207:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe668f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.400216:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe668f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.400237:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94161505da00) 00010000:00010000:3.0:1790736266.400241:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736266.400246:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe668f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.400254:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe668f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736266.405711:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736266.406745:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797214336 00000100:00100000:0.0:1790736266.406763:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797214336 00000100:00100000:0.0:1790736266.406857:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 59 00000100:00100000:0.0:1790736266.406871:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+24:10384:x1877722797214336:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:0.0:1790736266.406925:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736266.406955:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe6696 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526e3c expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.407437:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe669d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.407470:0:8114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6681 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e35 expref: 25 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.407480:0:8114:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe669d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.407526:0:8114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6681 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e35 expref: 25 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.407562:0:8114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6681 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e35 expref: 25 pid: 5845 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736266.407598:0:8114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163c521f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8114:1877722816119296:192.168.203.5@tcp:104: 00000100:00100000:0.0:1790736266.407744:0:8114:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607d783c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790736266.416814:0:8114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163c521f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8114:1877722816119296:192.168.203.5@tcp:104: 00010000:00010000:0.0:1790736266.416869:0:8114:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe669d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736266.416968:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736266.417058:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797214464 00000100:00100000:1.0:1790736266.417071:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797214464 00010000:00010000:1.0:1790736266.417189:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6681 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e35 expref: 26 pid: 5845 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736266.417243:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 41 00000100:00100000:1.0:1790736266.417257:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+26:2355:x1877722797214464:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790736266.417281:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736266.417290:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6681 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e35 expref: 26 pid: 5845 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.417305:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6681 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e35 expref: 26 pid: 5845 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.417339:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6681 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e35 expref: 26 pid: 5845 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.417363:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94161505da00) 00010000:00010000:1.0:1790736266.417369:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe669d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.417383:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe669d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.417417:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe669d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.417476:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790736266.417549:0:8114:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe669d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.417563:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe669d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736266.417578:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+25:2355:x1877722797214464:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 320us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736266.417604:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 41 00000004:00200000:2.0:1790736266.417671:0:8114:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1790736266.417676:0:8114:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790736266.417704:0:8114:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe669d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.417739:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe6696 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e3c expref: 25 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.417763:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe669d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e3c expref: 24 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.417772:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94161505da00) 00010000:00010000:2.0:1790736266.417775:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790736266.417779:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941642172200, rc 0) 00000100:00100000:2.0:1790736266.417840:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+24:10384:x1877722797214336:12345-192.168.203.5@tcp:101:bash.0 Request processed in 10970us (12141us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736266.417849:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 59 00000100:00100000:1.0:1790736266.425037:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736266.425644:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797214720 00000100:00100000:0.0:1790736266.425664:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797214720 00000100:00100000:0.0:1790736266.425766:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 15 00000100:00100000:0.0:1790736266.425781:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416114ec850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+24:10384:x1877722797214720:12345-192.168.203.5@tcp:35:bash.0 00000100:00100000:0.0:1790736266.426186:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416114ec850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+25:10384:x1877722797214720:12345-192.168.203.5@tcp:35:bash.0 Request processed in 409us (1167us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1790736266.426195:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 15 00000100:00100000:3.0:1790736266.511439:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736266.511567:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797214976 00000100:00100000:0.0:1790736266.511581:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797214976 00000100:00100000:0.0:1790736266.511657:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 60 00000100:00100000:0.0:1790736266.511671:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+25:10394:x1877722797214976:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1790736266.511710:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736266.511741:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe66a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526e43 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790736266.511870:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1790736266.512052:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe66a4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e43 expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.512135:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94160678ac00) 00010000:00010000:0.0:1790736266.512139:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790736266.512147:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe66a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e43 expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.512168:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941642173c00, rc 0) 00000100:00100000:0.0:1790736266.512250:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+26:10394:x1877722797214976:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 582us (826us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1790736266.512258:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 60 00000100:00100000:2.0:1790736266.517624:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736266.517787:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797215104 00000100:00100000:3.0:1790736266.517801:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797215104 00000100:00100000:3.0:1790736266.517880:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 61 00000100:00100000:3.0:1790736266.517893:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+26:10394:x1877722797215104:12345-192.168.203.5@tcp:34:lfs.0 00010000:00010000:3.0:1790736266.518022:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe66b2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.518051:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe66b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.518066:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe66b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.518087:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe66b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.518123:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe66b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.518130:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe66b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.519763:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe66c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.519787:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe66c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.519801:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe66c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790736266.519878:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe66c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.519895:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe66b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.519902:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe66b2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.519911:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe66b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.519918:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c8400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736266.519922:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe66b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.519930:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe66b2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.520012:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94161505d100) 00010000:00010000:3.0:1790736266.520016:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736266.520024:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe66b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.520032:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe66b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.520049:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe66b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.520055:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe66b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.520073:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe66b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.520078:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c9c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736266.520081:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe66b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.520088:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe66b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.520244:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94161505de00) 00010000:00010000:3.0:1790736266.520247:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736266.520251:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe66b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.520257:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe66b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.520280:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe66c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.520287:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe66c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.520293:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe66c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.520298:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c8e00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736266.520301:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe66c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.520319:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe66c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.520327:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94161505da00) 00010000:00010000:3.0:1790736266.520329:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736266.520332:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe66c0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.520348:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe66c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736266.520551:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+26:10394:x1877722797215104:12345-192.168.203.5@tcp:34:lfs.0 Request processed in 2647us (2928us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736266.520571:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 61 00000100:00100000:1.0:1790736266.524021:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736266.524225:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797215360 00000100:00100000:0.0:1790736266.524240:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797215360 00000100:00100000:0.0:1790736266.524347:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 16 00000100:00100000:0.0:1790736266.524360:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c5e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+26:10394:x1877722797215360:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:0.0:1790736266.524737:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c5e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+27:10394:x1877722797215360:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 379us (798us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1790736266.524746:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 16 00000100:00100000:1.0:1790736266.564923:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736266.565043:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797215616 00000100:00100000:2.0:1790736266.565062:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797215616 00000100:00100000:2.0:1790736266.565177:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 62 00000100:00100000:2.0:1790736266.565190:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c5e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+27:10397:x1877722797215616:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1790736266.565228:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736266.565258:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe66c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526e4a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.565382:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe66ce lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.565422:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe66ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.565437:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe66ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.565458:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe66d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.565466:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe66d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.565474:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe66d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.565905:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe66dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.565916:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe66dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.565924:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe66dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790736266.565938:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1790736266.566071:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe66ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.566080:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe66ce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.566087:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe66ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.566134:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941611931600 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736266.566140:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe66ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.566149:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe66ce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.566168:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94161505d100) 00010000:00010000:2.0:1790736266.566172:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790736266.566180:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe66ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.566187:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe66ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.566206:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe66d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.566214:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe66d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.566221:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe66d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.566226:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941611930c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736266.566229:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe66d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.566235:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe66d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.566256:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94160678a500) 00010000:00010000:2.0:1790736266.566258:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790736266.566261:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe66d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.566268:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe66d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.566339:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe66c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e4a expref: 30 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.566355:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe66dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e4a expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.566363:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94161505da00) 00010000:00010000:2.0:1790736266.566365:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790736266.566368:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611930400, rc 0) 00000100:00100000:2.0:1790736266.566487:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c5e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+29:10397:x1877722797215616:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1298us (1581us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1790736266.566497:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 62 00000100:00100000:2.0:1790736266.570839:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736266.570902:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736266.571075:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797215744 00000100:00100000:0.0:1790736266.571091:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797215744 00000100:00100000:0.0:1790736266.571213:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 63 00000100:00100000:0.0:1790736266.571224:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+29:10397:x1877722797215744:12345-192.168.203.5@tcp:54:lfs.0 00010000:00010000:0.0:1790736266.571324:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe66ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.571349:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe66ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.571392:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe66ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.571446:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe66ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.571456:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe66ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.571464:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe66ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.571472:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642173c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736266.571478:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe66ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.571486:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe66ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.571502:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94161505da00) 00010000:00010000:0.0:1790736266.571506:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790736266.571513:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe66ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.571520:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe66ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736266.571628:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+29:10397:x1877722797215744:12345-192.168.203.5@tcp:54:lfs.0 Request processed in 405us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736266.571637:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 63 00000100:00100000:1.0:1790736266.572699:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797215872 00000100:00100000:1.0:1790736266.572716:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797215872 00000100:00100000:1.0:1790736266.572848:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 4 00000100:00100000:1.0:1790736266.572867:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+29:2354:x1877722797215872:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790736266.572886:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736266.572913:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe66dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e4a expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.572932:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94161505da00) 00010000:00010000:1.0:1790736266.572937:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790736266.572995:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+28:2354:x1877722797215872:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 131us (2092us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736266.573003:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 4 00000100:00100000:3.0:1790736266.574216:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736266.574428:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797216128 00000100:00100000:0.0:1790736266.574457:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797216128 00000100:00100000:0.0:1790736266.574509:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 17 00000100:00100000:0.0:1790736266.574519:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+28:10397:x1877722797216128:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:0.0:1790736266.574815:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+29:10397:x1877722797216128:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 296us (608us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1790736266.574823:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 17 00000100:00100000:3.0:1790736266.680840:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736266.681076:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797216384 00000100:00100000:2.0:1790736266.681128:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797216384 00000100:00100000:2.0:1790736266.681220:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 64 00000100:00100000:2.0:1790736266.681232:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+29:10415:x1877722797216384:12345-192.168.203.5@tcp:101:cat.0 00010000:00010000:2.0:1790736266.681266:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736266.681312:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe66f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526e51 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.681665:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe66f8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.681684:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe66f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.681697:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe66f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790736266.681710:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1790736266.681873:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe66f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e51 expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.681896:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe66f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e51 expref: 31 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.681905:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94161505da00) 00010000:00010000:2.0:1790736266.681908:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790736266.681912:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611930c00, rc 0) 00000100:00100000:2.0:1790736266.682213:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+31:10415:x1877722797216384:12345-192.168.203.5@tcp:101:cat.0 Request processed in 982us (1385us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1790736266.682222:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 64 00000100:00100000:0.0:1790736266.699688:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736266.699924:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797216512 00000100:00100000:2.0:1790736266.699939:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797216512 00000100:00100000:2.0:1790736266.700075:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 65 00000100:00100000:2.0:1790736266.700089:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+31:10416:x1877722797216512:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1790736266.700197:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736266.700230:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe6706 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526e58 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.700328:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe670d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.700366:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe670d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.700379:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe670d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790736266.700430:0:8114:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1790736266.700436:0:8114:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790736266.700463:0:8114:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe670d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.700495:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe6706 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e58 expref: 33 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.700517:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe670d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e58 expref: 32 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.700527:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94161505d100) 00010000:00010000:2.0:1790736266.700530:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790736266.700534:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611931600, rc 0) 00000100:00100000:2.0:1790736266.700734:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+32:10416:x1877722797216512:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 647us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736266.700743:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 65 00000100:00100000:0.0:1790736266.705928:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736266.706042:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797216896 00000100:00100000:1.0:1790736266.706057:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797216896 00000100:00100000:1.0:1790736266.706170:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18 00000100:00100000:1.0:1790736266.706182:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+32:10416:x1877722797216896:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:1.0:1790736266.706793:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+33:10416:x1877722797216896:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 608us (877us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1790736266.706803:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18 00000100:00100000:1.0:1790736266.709265:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736266.709384:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797217024 00000100:00100000:2.0:1790736266.709407:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797217024 00000100:00100000:2.0:1790736266.709495:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 5 00000100:00100000:2.0:1790736266.709506:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c5e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+33:10416:x1877722797217024:12345-192.168.203.5@tcp:103:lfs.0 00010000:00010000:2.0:1790736266.709528:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1790736266.709577:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe669d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e3c expref: 33 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.709609:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe66f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e51 expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.709623:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9000/0x6aae200528fe65a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526dfd expref: 31 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.709635:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94161505da00) 00010000:00010000:2.0:1790736266.709650:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790736266.709731:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c5e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+30:10416:x1877722797217024:12345-192.168.203.5@tcp:103:lfs.0 Request processed in 226us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736266.709740:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 5 00000100:00100000:0.0:1790736266.712225:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736266.712336:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797217152 00000100:00100000:2.0:1790736266.712360:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797217152 00000100:00100000:2.0:1790736266.712436:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 66 00000100:00100000:2.0:1790736266.712448:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+30:10416:x1877722797217152:12345-192.168.203.5@tcp:58:lfs.0 00010000:00010000:2.0:1790736266.712643:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe6714 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.712665:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe6714 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.712686:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe6714 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790736266.713437:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790736266.713662:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1790736266.713740:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1790736266.713897:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+30:10416:x1877722797217152:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 1445us (1679us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736266.713908:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 66 00000100:00100000:1.0:1790736266.735993:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736266.736089:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797217280 00000100:00100000:3.0:1790736266.736150:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797217280 00000100:00100000:3.0:1790736266.736233:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 67 00000100:00100000:3.0:1790736266.736245:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163393f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+30:10418:x1877722797217280:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1790736266.736278:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736266.736309:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe671b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526e5f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.736495:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6722 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.736514:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6722 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.736559:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6722 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.736579:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe6729 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.736587:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe6729 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.736594:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe6729 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.736893:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe6730 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.736904:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe6730 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.736912:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe6730 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790736266.736963:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1790736266.736968:0:5845:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790736266.736988:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe6730 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.737001:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe6730 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.737011:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6722 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.737029:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6722 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.737037:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6722 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.737042:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c9c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736266.737047:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6722 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.737056:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6722 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.737069:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94161505d100) 00010000:00010000:3.0:1790736266.737074:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736266.737079:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6722 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.737086:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6722 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.737139:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe6729 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.737145:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe6729 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.737151:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe6729 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.737156:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c8400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736266.737165:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe6729 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.737172:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe6729 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.737180:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94161505de00) 00010000:00010000:3.0:1790736266.737183:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736266.737186:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe6729 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.737192:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe6729 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.737236:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe671b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e5f expref: 32 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.737253:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe6730 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e5f expref: 31 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.737261:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94160678a500) 00010000:00010000:3.0:1790736266.737264:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790736266.737267:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c9800, rc 0) 00000100:00100000:3.0:1790736266.737368:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163393f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+31:10418:x1877722797217280:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1125us (1392us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736266.737376:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 67 00000040:00080000:2.0:1790736266.837528:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790736266.837552:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790736266.837632:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1790736266.837641:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790736266.837821:0:11704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163380d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11704:1877722816119424:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790736266.837972:0:11704:0:(client.c:2716:ptlrpc_set_wait()) set ffff94161871acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790736266.842588:0:11704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163380d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11704:1877722816119424:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790736266.856879:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736266.858714:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797217408 00000100:00100000:3.0:1790736266.858734:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797217408 00000100:00100000:3.0:1790736266.858842:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1 00000100:00100000:3.0:1790736266.858855:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f945944d-9086-46a2-a91c-8bc7b88e8918+31:10429:x1877722797217408:12345-192.168.203.5@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1790736266.859003:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f945944d-9086-46a2-a91c-8bc7b88e8918+31:10429:x1877722797217408:12345-192.168.203.5@tcp:900:lhsmtool_posix.0 Request processed in 151us (2139us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736266.859014:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1 00000100:00100000:0.0:1790736266.864329:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736266.864421:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797217536 00000100:00100000:2.0:1790736266.864433:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797217536 00000100:00100000:2.0:1790736266.864499:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 68 00000100:00100000:2.0:1790736266.864509:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+31:10429:x1877722797217536:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790736266.864571:0:5844:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790736266.864745:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+31:10429:x1877722797217536:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 236us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736266.864753:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 68 00000100:00100000:2.0:1790736266.872212:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736266.873429:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797217664 00000100:00100000:1.0:1790736266.873444:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797217664 00000100:00100000:1.0:1790736266.873527:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 69 00000100:00100000:1.0:1790736266.873546:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+31:10429:x1877722797217664:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1790736266.873650:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6737 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.873672:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6737 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.873685:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6737 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.879320:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe673e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.879348:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe673e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.879361:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe673e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.879403:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6745 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.879431:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6745 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.879439:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6745 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790736266.879487:0:8114:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1790736266.879493:0:8114:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790736266.879528:0:8114:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6745 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.879550:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6737 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.879557:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6737 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.879566:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6737 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.879574:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60e00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736266.879578:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6737 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.879585:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6737 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.879600:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94160678a900) 00010000:00010000:1.0:1790736266.879603:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736266.879608:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6737 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.879628:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6737 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.879645:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe673e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.879651:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe673e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.879657:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe673e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.879662:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60800 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736266.879665:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe673e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.879671:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe673e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.879681:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff941603253100) 00010000:00010000:1.0:1790736266.879684:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736266.879687:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe673e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.879693:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe673e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.879714:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6745 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.879721:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6745 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.879735:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6745 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.879741:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60a00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736266.879744:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6745 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.879751:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6745 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.879760:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94160678a500) 00010000:00010000:1.0:1790736266.879763:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736266.879767:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6745 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.879773:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6745 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736266.882365:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+31:10429:x1877722797217664:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 Request processed in 8818us (10159us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736266.882380:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 69 00000100:00100000:0.0:1790736266.887651:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736266.887778:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797217920 00000100:00100000:2.0:1790736266.887790:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797217920 00000100:00100000:2.0:1790736266.887860:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 70 00000100:00100000:2.0:1790736266.887871:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+31:10429:x1877722797217920:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790736266.887905:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736266.887936:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe674c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526e66 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.888117:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931800/0x6aae200528fe6753 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.888136:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611931800/0x6aae200528fe6753 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.888149:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931800/0x6aae200528fe6753 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790736266.888162:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1790736266.888305:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931800/0x6aae200528fe6753 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.888315:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611931800/0x6aae200528fe6753 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.888321:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941611931800/0x6aae200528fe6753 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.888327:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941611931800 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736266.888331:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611931800/0x6aae200528fe6753 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.888338:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611931800/0x6aae200528fe6753 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.888367:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94160678a500) 00010000:00010000:2.0:1790736266.888370:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790736266.888376:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941611931800/0x6aae200528fe6753 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.888383:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931800/0x6aae200528fe6753 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.888440:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe674c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e66 expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.888452:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94160678a900) 00010000:00010000:2.0:1790736266.888455:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790736266.888459:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe674c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e66 expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.888469:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611931000, rc 0) 00000100:00100000:2.0:1790736266.888551:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+32:10429:x1877722797217920:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 681us (911us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1790736266.888566:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 70 00000100:00100000:0.0:1790736266.897025:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736266.898705:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797218048 00000100:00100000:3.0:1790736266.898723:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797218048 00000100:00100000:3.0:1790736266.898801:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 71 00000100:00100000:3.0:1790736266.898815:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+32:10429:x1877722797218048:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790736266.898867:0:5845:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790736266.899004:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+32:10429:x1877722797218048:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 192us (1991us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736266.899012:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 71 00000100:00100000:1.0:1790736266.909676:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736266.910402:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797218304 00000100:00100000:0.0:1790736266.910422:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797218304 00000100:00100000:0.0:1790736266.910522:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 72 00000100:00100000:0.0:1790736266.910535:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163393ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+32:10429:x1877722797218304:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790736266.910578:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736266.910585:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790736266.910628:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe670d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e58 expref: 32 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.910653:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94161505d100) 00010000:00010000:0.0:1790736266.910659:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790736266.910680:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6761 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526e6d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790736266.911686:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1790736266.912077:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe6768 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.912140:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe6768 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.912156:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe6768 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.912245:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6761 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e6d expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.912270:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe6768 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e6d expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.912280:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff941605242100) 00010000:00010000:0.0:1790736266.912284:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790736266.912287:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941642173600, rc 0) 00000100:00100000:0.0:1790736266.912399:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163393ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+33:10429:x1877722797218304:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 1865us (2736us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1790736266.912410:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 72 00000100:00100000:0.0:1790736266.917838:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736266.917921:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797218560 00000100:00100000:1.0:1790736266.917937:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797218560 00000100:00100000:1.0:1790736266.918008:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 73 00000100:00100000:1.0:1790736266.918022:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+33:10429:x1877722797218560:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790736266.918132:0:8114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736266.918160:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe6768 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e6d expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.918200:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff941605242100) 00010000:00010000:1.0:1790736266.918214:0:8114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790736266.918244:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6776 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.918260:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6776 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.918272:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6776 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.918288:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe677d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xe1b00e3e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.918296:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe677d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe1b00e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.918303:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe677d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe1b00e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.922573:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6776 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.922604:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6776 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.922617:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6776 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.922624:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60800 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736266.922630:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6776 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.922659:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6776 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.922680:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94161505d100) 00010000:00010000:1.0:1790736266.922684:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736266.922689:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6776 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.922696:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6776 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.922716:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe677d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe1b00e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.922722:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe677d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe1b00e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.922728:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe677d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe1b00e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.922734:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60e00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736266.922736:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe677d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe1b00e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.922741:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe677d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe1b00e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.922748:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xe1b00e3e (ffff941603253100) 00010000:00010000:1.0:1790736266.922750:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736266.922752:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe677d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe1b00e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.922767:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe677d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe1b00e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736266.922935:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+32:10429:x1877722797218560:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 4911us (5107us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790736266.922947:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 73 00000100:00100000:1.0:1790736266.925003:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736266.926633:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797218688 00000100:00100000:2.0:1790736266.926649:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797218688 00000100:00100000:2.0:1790736266.926774:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 74 00000100:00100000:2.0:1790736266.926784:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163393f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+32:10429:x1877722797218688:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790736266.926804:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736266.926828:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931800/0x6aae200528fe6784 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526e74 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.926890:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe678b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.926902:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe678b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.926914:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe678b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.927008:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931800/0x6aae200528fe6784 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e74 expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.927026:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe678b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e74 expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736266.927035:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94160678aa00) 00010000:00010000:2.0:1790736266.927037:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790736266.927042:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611930c00, rc 0) 00000100:00100000:2.0:1790736266.927329:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163393f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+33:10429:x1877722797218688:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 541us (2331us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736266.927342:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 74 00000100:00100000:3.0:1790736266.933156:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736266.933395:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797218944 00000100:00100000:0.0:1790736266.933414:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797218944 00000100:00100000:0.0:1790736266.933512:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 75 00000100:00100000:0.0:1790736266.933525:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+33:10429:x1877722797218944:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790736266.933758:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6792 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.933799:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6792 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736266.933813:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6792 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790736266.935439:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1790736266.935466:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 338946370985ns, next at 339946365181ns, rc = 0 00000004:00010000:0.0:1790736266.935910:0:5845:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000029c78cae reply state 000000006b532b95 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6792 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736266.935925:0:5845:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790736266.936087:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+35:10429:x1877722797218944:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 2560us (2935us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1790736266.936121:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 75 00010000:00010000:3.0:1790736266.946151:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6792 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.946177:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6792 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.946187:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6792 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.946260:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642172200 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736266.946267:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6792 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.946278:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6792 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.946307:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94160678aa00) 00010000:00010000:3.0:1790736266.946334:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790736266.946343:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6792 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736266.946351:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6792 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736266.947122:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736266.948214:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797219072 00000100:00100000:1.0:1790736266.948227:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797219072 00000100:00100000:1.0:1790736266.948302:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 76 00000100:00100000:1.0:1790736266.948315:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+34:10429:x1877722797219072:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790736266.948345:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736266.948369:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6799 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526e7b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.948437:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6799 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e7b expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.948452:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6799 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e7b expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736266.948473:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94160678aa00) 00010000:00010000:1.0:1790736266.948476:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790736266.948480:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c60e00, rc 0) 00000100:00100000:1.0:1790736266.951016:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+35:10429:x1877722797219072:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 2683us (3900us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736266.951062:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 76 00000100:00100000:1.0:1790736266.960341:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736266.960412:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797219200 00000100:00100000:1.0:1790736266.960422:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797219200 00000100:00100000:1.0:1790736266.960470:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 25 00000100:00100000:1.0:1790736266.960479:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163393e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1877722797219200:12345-192.168.203.5@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1790736266.960512:0:6698:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from f945944d-9086-46a2-a91c-8bc7b88e8918@192.168.203.5@tcp t0 exp 0000000000000000 cur 338 last 0 00000020:00000080:1.0:1790736266.960555:0:6698:0:(genops.c:1384:class_connect()) connect: client f945944d-9086-46a2-a91c-8bc7b88e8918, cookie 0x6aae200528fe67a0 00002000:00100000:1.0:1790736266.960578:0:6698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f945944d-9086-46a2-a91c-8bc7b88e8918/ffff94162a7c6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790736266.960604:0:6698:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790736266.960836:0:6698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1790736266.962832:0:6698:0:(import.c:65:import_set_state_nolock()) ffff94162a7c1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790736266.962995:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163393e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2352:x1877722797219200:12345-192.168.203.5@tcp:8:lhsmtool_posix.0 Request processed in 2511us (2663us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736266.963007:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 25 00000100:00100000:1.0:1790736266.967778:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736266.968132:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797219328 00000100:00100000:2.0:1790736266.968143:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797219328 00000100:00100000:2.0:1790736266.968302:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 26 00000100:00100000:2.0:1790736266.968315:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+6:0:x1877722797219328:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1790736266.968896:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790736267.029581:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790736267.030157:0:6725:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f945944d-9086-46a2-a91c-8bc7b88e8918 00000100:00100000:0.0:1790736267.030419:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+6:0:x1877722797219328:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 Request processed in 62098us (62641us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1790736267.030433:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 26 00000001:00080000:2.0:1790736267.030865:0:6725:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:2.0:1790736267.034391:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736267.034913:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797219584 00000100:00100000:1.0:1790736267.034927:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797219584 00000100:00100000:1.0:1790736267.035041:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 19 00000100:00100000:1.0:1790736267.035054:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+35:10429:x1877722797219584:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790736267.035416:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+36:10429:x1877722797219584:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 363us (1039us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1790736267.035425:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 19 00000100:00100000:0.0:1790736267.052891:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736267.055917:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797219840 00000100:00100000:2.0:1790736267.055940:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797219840 00000100:00100000:2.0:1790736267.056072:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 77 00000100:00100000:2.0:1790736267.056085:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c521500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+36:10429:x1877722797219840:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790736267.056287:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c521500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+36:10429:x1877722797219840:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 204us (3411us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736267.056297:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 77 00000100:00100000:2.0:1790736267.059816:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736267.059909:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797219968 00000100:00100000:3.0:1790736267.059925:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797219968 00000100:00100000:3.0:1790736267.060013:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 78 00000100:00100000:3.0:1790736267.060024:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162edc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+36:10429:x1877722797219968:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790736267.060051:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736267.060077:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe67a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526e82 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.060191:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe67ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.060210:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe67ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.060222:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe67ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790736267.060271:0:8114:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790736267.060300:0:8114:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe67ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.060334:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe67a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e82 expref: 38 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.060378:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe67ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e82 expref: 37 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.060389:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94160678aa00) 00010000:00010000:3.0:1790736267.060451:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790736267.060455:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c8400, rc 0) 00000100:00100000:3.0:1790736267.060522:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162edc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+37:10429:x1877722797219968:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 500us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736267.060529:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 78 00000100:00100000:3.0:1790736267.069030:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736267.069181:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797220096 00000100:00100000:0.0:1790736267.069253:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797220096 00000100:00100000:0.0:1790736267.069390:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 27 00000100:00100000:0.0:1790736267.069404:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2355:x1877722797220096:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790736267.069431:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736267.069579:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074f72480/0x6aae200528fe67b5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526e89 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790736267.069652:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abc778b, blocks: 0x1 00010000:00010000:0.0:1790736267.069680:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1790736267.069686:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736267.069698:0:6697:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074f72480/0x6aae200528fe67b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e89 expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.069723:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000074f72480/0x6aae200528fe67b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e89 expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.069751:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941642173200, rc 0) 00000100:00100000:0.0:1790736267.069836:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2355:x1877722797220096:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 434us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736267.069844:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 27 00000100:00100000:0.0:1790736267.078596:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736267.078690:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797220352 00000100:00100000:3.0:1790736267.078704:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797220352 00000100:00100000:3.0:1790736267.078783:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 79 00000100:00100000:3.0:1790736267.078796:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c520380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+37:10429:x1877722797220352:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790736267.078956:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c520380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+37:10429:x1877722797220352:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 163us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736267.078965:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 79 00000100:00100000:2.0:1790736267.082186:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736267.086124:0:8632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797220480 00000100:00100000:0.0:1790736267.086141:0:8632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797220480 00000100:00100000:0.0:1790736267.086535:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 28 00000100:00100000:0.0:1790736267.086557:0:8632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+6:10429:x1877722797220480:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790736267.086581:0:8632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736267.086605:0:8632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f67c1b0f/0x6aae200528fe67bc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526e90 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.086743:0:8632:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000074f72480/0x6aae200528fe67b5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e89 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.086765:0:8632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736267.086770:0:8632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736267.086777:0:8632:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f67c1b0f/0x6aae200528fe67bc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e90 expref: 7 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.086824:0:8632:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000074f72480/0x6aae200528fe67b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e89 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.086839:0:8632:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000074f72480/0x6aae200528fe67b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e89 expref: 7 pid: 6697 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736267.086855:0:8632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163c522a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8632:1877722816119552:192.168.203.5@tcp:104: 00000100:00100000:0.0:1790736267.086995:0:8632:0:(client.c:2716:ptlrpc_set_wait()) set ffff94161112b240 going to sleep for 11 seconds 00000100:00100000:2.0:1790736267.100517:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736267.100820:0:8632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163c522a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8632:1877722816119552:192.168.203.5@tcp:104: 00010000:00010000:0.0:1790736267.100867:0:8632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f67c1b0f/0x6aae200528fe67bc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0x92962417a526e90 expref: 7 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.100895:0:8632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941642172200, rc 0) 00000100:00100000:0.0:1790736267.100973:0:8632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+7:10429:x1877722797220480:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 14419us (18802us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736267.100983:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 28 00000100:00100000:3.0:1790736267.101020:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797220608 00000100:00100000:3.0:1790736267.101029:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797220608 00010000:00010000:3.0:1790736267.101071:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000074f72480/0x6aae200528fe67b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e89 expref: 7 pid: 6697 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736267.104635:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 42 00000100:00100000:3.0:1790736267.104659:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160557d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+7:2356:x1877722797220608:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790736267.104713:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790736267.104751:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000074f72480/0x6aae200528fe67b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e89 expref: 7 pid: 6697 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.104776:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000074f72480/0x6aae200528fe67b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e89 expref: 7 pid: 6697 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.104806:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074f72480/0x6aae200528fe67b5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e89 expref: 7 pid: 6697 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.104826:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790736267.104830:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790736267.104841:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f67c1b0f/0x6aae200528fe67bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0x92962417a526e90 expref: 6 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.104852:0:5828:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f67c1b0f/0x6aae200528fe67bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0x92962417a526e90 expref: 6 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.104909:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f67c1b0f/0x6aae200528fe67bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0x92962417a526e90 expref: 6 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736267.104937:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163381b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5828:1877722816119680:192.168.203.5@tcp:105: 00000100:00100000:3.0:1790736267.105064:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416106f3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790736267.124077:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736267.124577:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163381b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5828:1877722816119680:192.168.203.5@tcp:105: 00010000:00010000:0.0:1790736267.124615:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790736267.124709:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160557d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2356:x1877722797220608:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 20060us (24207us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736267.124732:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 42 00000100:00100000:3.0:1790736267.125175:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797220736 00000100:00100000:3.0:1790736267.125187:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797220736 00002000:00100000:3.0:1790736267.125250:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff941635cf9c00 x1877722797220736/t0(0) o4->f945944d-9086-46a2-a91c-8bc7b88e8918@192.168.203.5@tcp:98/0 lens 504/0 e 0 to 0 dl 1790736278 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790736267.125269:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff941635cf9c00 with x1877722797220736 ext(0->8) 00002000:00010000:3.0:1790736267.125276:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff941635cf9c00 00000100:00100000:3.0:1790736267.125310:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 0 00000100:00100000:3.0:1790736267.125320:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2356:x1877722797220736:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1790736267.133276:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+8:2356:x1877722797220736:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 7943us (9199us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1790736267.133299:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 0 00002000:00100000:2.0:1790736267.133318:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff941635cf9c00 x1877722797220736/t4294967302(0) o4->f945944d-9086-46a2-a91c-8bc7b88e8918@192.168.203.5@tcp:98/0 lens 504/448 e 0 to 0 dl 1790736278 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790736267.133330:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff941635cf9c00 with x1877722797220736 ext(0->8) 00002000:00010000:2.0:1790736267.133338:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff941635cf9c00 00000100:00100000:3.0:1790736267.136629:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736267.136756:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797220864 00000100:00100000:0.0:1790736267.136778:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797220864 00000100:00100000:0.0:1790736267.136865:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 80 00000100:00100000:0.0:1790736267.136879:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633818a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+37:10429:x1877722797220864:12345-192.168.203.5@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1790736267.231085:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633818a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+37:10429:x1877722797220864:12345-192.168.203.5@tcp:44:lhsmtool_posix.0 Request processed in 94190us (94452us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736267.231134:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 80 00000001:00080000:0.0:1790736267.231307:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:0.0:1790736267.231316:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000001:00080000:0.0:1790736267.231362:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:0.0:1790736267.231401:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:0.0:1790736267.233802:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1790736267.233821:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1790736267.233841:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163c522a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816119808:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1790736267.233925:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736267.234180:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816119808 00000100:00100000:0.0:1790736267.234257:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816119808 00000100:00100000:0.0:1790736267.234341:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790736267.234353:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c523800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816119808:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1790736267.234827:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1790736267.234832:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1790736267 00002000:00010000:0.0:1790736267.234835:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1790736267.234839:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1790736267 -> 1790736267 00002000:00010000:0.0:1790736267.234842:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00080000:1.0:1790736267.235308:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790736267.237499:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736267.237736:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797220992 00000100:00100000:1.0:1790736267.237756:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797220992 00000100:00100000:1.0:1790736267.237836:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 30 00000100:00100000:1.0:1790736267.237848:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+8:2354:x1877722797220992:12345-192.168.203.5@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1790736267.238934:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c523800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1877722816119808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 4572us (4996us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1790736267.238950:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:1.0:1790736267.242106:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94163c522a00/2, rc 0, transno 4294967303 00000100:00100000:1.0:1790736267.242127:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163c522a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816119808:0@lo:2:osp-syn-0-0.0 00000001:00080000:1.0:1790736267.364716:0:6725:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1790736267.364745:0:6725:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:1.0:1790736267.364935:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2354:x1877722797220992:12345-192.168.203.5@tcp:16:lhsmtool_posix.0 Request processed in 127076us (127436us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736267.364951:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 30 00000100:00100000:2.0:1790736267.370330:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736267.371842:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797221248 00000100:00100000:3.0:1790736267.371863:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797221248 00000100:00100000:3.0:1790736267.371951:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 81 00000100:00100000:3.0:1790736267.371962:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+13:10429:x1877722797221248:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790736267.372037:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790736267.372074:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe67ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e82 expref: 13 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.372135:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94160678aa00) 00010000:00010000:3.0:1790736267.372141:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790736267.372179:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe67c3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.372206:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe67c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.372217:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe67c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790736267.375961:0:5845:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f0ade2da reply state 00000000760a6d43 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe67c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736267.375980:0:5845:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790736267.376202:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+14:10429:x1877722797221248:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 4237us (5882us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1790736267.376228:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 81 00000100:00100000:2.0:1790736267.381892:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736267.382220:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797221376 00000100:00100000:1.0:1790736267.382237:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797221376 00000100:00100000:1.0:1790736267.382312:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 31 00000100:00100000:1.0:1790736267.382324:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2356:x1877722797221376:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1790736267.382856:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1790736267.382861:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1790736267 -> 1790736266 00002000:00010000:1.0:1790736267.382864:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1790736265 00002000:00010000:1.0:1790736267.382867:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1790736267 -> 1790736266 00002000:00010000:1.0:1790736267.382870:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1790736267.382952:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+7:2356:x1877722797221376:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 Request processed in 628us (1067us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1790736267.382962:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 31 00010000:00010000:3.0:1790736267.383519:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe67c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.383566:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe67c3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.383574:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe67c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.383582:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c8e00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736267.383588:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe67c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.383597:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe67c3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.383625:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94160678aa00) 00010000:00010000:3.0:1790736267.383630:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736267.383636:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe67c3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.383644:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe67c3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736267.391745:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736267.391884:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797221632 00000100:00100000:2.0:1790736267.391897:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797221632 00000100:00100000:2.0:1790736267.391979:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 82 00000100:00100000:2.0:1790736267.391990:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163381bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+13:10429:x1877722797221632:12345-192.168.203.5@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1790736267.392080:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe67ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.392134:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe678b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e74 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.392144:0:5843:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe67ca lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.392234:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe678b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e74 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.392250:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe678b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e74 expref: 13 pid: 5844 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736267.392269:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f7f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1877722816119936:192.168.203.5@tcp:104: 00000100:00100000:2.0:1790736267.392578:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff941609a10180 going to sleep for 11 seconds 00000100:00100000:2.0:1790736267.406602:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736267.406800:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f7f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1877722816119936:192.168.203.5@tcp:104: 00010000:00010000:0.0:1790736267.406839:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe67ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736267.407230:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797221760 00000100:00100000:0.0:1790736267.407241:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797221760 00010000:00010000:0.0:1790736267.407295:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe678b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e74 expref: 14 pid: 5844 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736267.407347:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 43 00000100:00100000:0.0:1790736267.407358:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+14:2355:x1877722797221760:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790736267.407379:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790736267.407387:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe678b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e74 expref: 14 pid: 5844 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.407414:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe678b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e74 expref: 14 pid: 5844 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.407452:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe678b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e74 expref: 14 pid: 5844 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.407472:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94160678aa00) 00010000:00010000:0.0:1790736267.407477:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe67ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.407512:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe67ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.407522:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe67ca lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.407561:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790736267.407795:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+13:2355:x1877722797221760:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 437us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736267.407806:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 43 00010000:00010000:0.0:1790736267.407958:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe67ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.407965:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe67ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.408006:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe67ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.408015:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe67ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.408024:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe67ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.408030:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941611931a00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736267.408035:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe67ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.408044:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe67ca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.408062:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94160678aa00) 00010000:00010000:0.0:1790736267.408064:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1790736267.408069:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe67ca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.408077:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe67ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736267.408163:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163381bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+12:10429:x1877722797221632:12345-192.168.203.5@tcp:55:lhsmtool_posix.0 Request processed in 16176us (16431us total) trans 0 rc -22/-22 00000100:00100000:0.0:1790736267.408172:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 82 00000100:00100000:2.0:1790736267.411983:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736267.412070:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797221888 00000100:00100000:1.0:1790736267.412132:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797221888 00000100:00100000:1.0:1790736267.412205:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 32 00000100:00100000:1.0:1790736267.412216:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+7:2355:x1877722797221888:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1790736267.412272:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c9a369b1/0x6aae200528fe67d1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736267.412297:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f67c1b0f/0x6aae200528fe67bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0x92962417a526e90 expref: 7 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736267.412307:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790736267.412312:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790736267.412318:0:6698:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9a369b1/0x6aae200528fe67d1 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736267.412359:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f67c1b0f/0x6aae200528fe67bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.5@tcp remote: 0x92962417a526e90 expref: 7 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736267.412376:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f67c1b0f/0x6aae200528fe67bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a526e90 expref: 7 pid: 8632 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736267.412403:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941635cfb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6698:1877722816120064:192.168.203.5@tcp:104: 00000100:00100000:1.0:1790736267.412507:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607c03f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790736267.417362:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941635cfb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6698:1877722816120064:192.168.203.5@tcp:104: 00010000:00010000:1.0:1790736267.417416:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c9a369b1/0x6aae200528fe67d1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736267.418823:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736267.419499:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797222016 00000100:00100000:1.0:1790736267.419515:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797222016 00010000:00010000:1.0:1790736267.419593:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f67c1b0f/0x6aae200528fe67bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a526e90 expref: 8 pid: 8632 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736267.419651:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 44 00000100:00100000:1.0:1790736267.419664:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633818e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+8:2355:x1877722797222016:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790736267.419685:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736267.419714:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f67c1b0f/0x6aae200528fe67bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a526e90 expref: 8 pid: 8632 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736267.419731:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f67c1b0f/0x6aae200528fe67bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a526e90 expref: 8 pid: 8632 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736267.419764:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f67c1b0f/0x6aae200528fe67bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.5@tcp remote: 0x92962417a526e90 expref: 8 pid: 8632 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736267.419787:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790736267.419793:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790736267.419801:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c9a369b1/0x6aae200528fe67d1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736267.419813:0:5830:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9a369b1/0x6aae200528fe67d1 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736267.419873:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790736267.419952:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633818e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+7:2355:x1877722797222016:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 289us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736267.419961:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 44 00010000:00010000:1.0:1790736267.420000:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c9a369b1/0x6aae200528fe67d1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736267.420012:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9a369b1/0x6aae200528fe67d1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736267.420044:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c9a369b1/0x6aae200528fe67d1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736267.420055:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9a369b1/0x6aae200528fe67d1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736267.420065:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9a369b1/0x6aae200528fe67d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736267.420073:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60c00 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:1.0:1790736267.420078:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9a369b1/0x6aae200528fe67d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736267.420089:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9a369b1/0x6aae200528fe67d1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736267.420146:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9a369b1/0x6aae200528fe67d1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736267.420155:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9a369b1/0x6aae200528fe67d1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736267.420229:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2355:x1877722797221888:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 8014us (8260us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736267.420239:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 32 00000100:00100000:2.0:1790736267.430429:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736267.430734:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797222272 00000100:00100000:3.0:1790736267.430748:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797222272 00000100:00100000:3.0:1790736267.430819:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 83 00000100:00100000:3.0:1790736267.430832:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+12:10429:x1877722797222272:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790736267.430937:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe67d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.430984:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe67d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.430998:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe67d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.431515:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe67df lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.431542:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6799 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e7b expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.431670:0:5844:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe67df lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.431717:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6799 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e7b expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.431735:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6799 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e7b expref: 13 pid: 5843 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736267.431752:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163381b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1877722816120192:192.168.203.5@tcp:104: 00000100:00100000:3.0:1790736267.431866:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff941621568c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790736267.448620:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736267.448776:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797222400 00000100:00100000:1.0:1790736267.448792:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797222400 00010000:00010000:1.0:1790736267.448856:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6799 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e7b expref: 14 pid: 5843 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736267.448916:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 45 00000100:00100000:1.0:1790736267.448927:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c522d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+14:2355:x1877722797222400:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790736267.448946:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736267.448954:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6799 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e7b expref: 14 pid: 5843 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736267.448971:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6799 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e7b expref: 14 pid: 5843 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736267.448999:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94160678aa00) 00010000:00010000:1.0:1790736267.449006:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe67df lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736267.449028:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe67df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736267.449037:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe67df lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736267.449060:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790736267.449173:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c522d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+14:2355:x1877722797222400:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 246us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736267.449182:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 45 00010000:00010000:2.0:1790736267.452089:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6799 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e7b expref: 13 pid: 5843 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736267.452147:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163381b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1877722816120192:192.168.203.5@tcp:104: 00010000:00010000:2.0:1790736267.452183:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe67df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.452288:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe67df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.452295:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe67df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790736267.452571:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1790736267.452929:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1790736267.452979:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1790736267.453310:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f7f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5844:1877722816120320:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1790736267.453398:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736267.453494:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416057689c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790736267.456158:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816120320 00000100:00100000:1.0:1790736267.456181:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816120320 00000100:00100000:1.0:1790736267.456273:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790736267.456285:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1877722816120320:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1790736267.456729:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1877722816120320:12345-0@lo:1000:mdt00_001.0 Request processed in 444us (3328us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736267.456741:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790736267.456954:0:5844:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1790736267.456963:0:5844:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94163c522a00, transno 4294967303 00000100:00100000:2.0:1790736267.457019:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f7f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5844:1877722816120320:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1790736267.458011:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1790736267.458167:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f7f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5844:1877722816120448:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1790736267.458261:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736267.458298:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162178a780 going to sleep for 11 seconds 00000100:00100000:1.0:1790736267.458614:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816120448 00000100:00100000:1.0:1790736267.458625:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816120448 00000100:00100000:1.0:1790736267.458690:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790736267.458701:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1877722816120448:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1790736267.459000:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5844:x1877722816120448:12345-0@lo:1000:mdt00_001.0 Request processed in 300us (738us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1790736267.459010:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790736267.459558:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f7f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5844:1877722816120448:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1790736267.459664:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe67df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.459678:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe67df lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.459697:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe67df lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.459704:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c8400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736267.459709:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe67df lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.459718:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe67df lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.459736:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94160678aa00) 00010000:00010000:3.0:1790736267.459740:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790736267.459745:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe67df lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.459752:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe67df lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.459795:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe6714 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.459802:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe6714 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.459808:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe6714 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.459814:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941611931c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736267.459817:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe6714 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.459833:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe6714 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.459842:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94160678a500) 00010000:00010000:3.0:1790736267.459844:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790736267.459847:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe6714 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.459853:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe6714 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.459904:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe67e6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.459922:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe6730 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e5f expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.459931:0:5844:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe67e6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.459970:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe6730 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e5f expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.459989:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe6730 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e5f expref: 16 pid: 5845 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736267.460007:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163381b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1877722816120576:192.168.203.5@tcp:104: 00000100:00100000:2.0:1790736267.463236:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162a685840 going to sleep for 11 seconds 00000100:00100000:3.0:1790736267.464767:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736267.464810:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797222528 00000100:00100000:3.0:1790736267.464835:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797222528 00010000:00010000:3.0:1790736267.464889:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe6730 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e5f expref: 17 pid: 5845 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736267.464935:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 46 00000100:00100000:3.0:1790736267.464946:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633819880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+17:2356:x1877722797222528:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790736267.464964:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790736267.464971:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe6730 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e5f expref: 17 pid: 5845 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.464986:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe6730 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e5f expref: 17 pid: 5845 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.465012:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94160678a500) 00010000:00010000:3.0:1790736267.465018:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe67e6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.465031:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe67e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.465039:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe67e6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.465061:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790736267.465156:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633819880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+17:2356:x1877722797222528:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 211us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736267.465166:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 46 00010000:00010000:2.0:1790736267.465676:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe6730 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e5f expref: 16 pid: 5845 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736267.465715:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163381b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1877722816120576:192.168.203.5@tcp:104: 00010000:00010000:2.0:1790736267.465749:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe67e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.465795:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe67e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.465803:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe67e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.465819:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe67e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.465827:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe67e6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.465836:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe67e6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.465842:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c9c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736267.465848:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe67e6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.465857:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe67e6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.465871:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94160678a500) 00010000:00010000:2.0:1790736267.465874:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790736267.465879:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe67e6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.465898:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe67e6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.465911:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe67d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.465918:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe67d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.465925:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe67d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.465930:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c8e00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736267.465933:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe67d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.465940:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe67d8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.465948:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94160678a500) 00010000:00010000:2.0:1790736267.465951:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790736267.465954:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe67d8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.465960:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe67d8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736267.466302:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+15:10429:x1877722797222272:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 35470us (35887us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1790736267.466313:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 83 00000020:00080000:2.0:1790736267.466323:0:5844:0:(tgt_main.c:787:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1790736267.466739:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790736267.466746:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790736267.466775:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1790736267.466782:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790736267.470773:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736267.470890:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797222784 00000100:00100000:0.0:1790736267.470904:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797222784 00000100:00100000:0.0:1790736267.471028:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 20 00000100:00100000:0.0:1790736267.471041:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+15:10429:x1877722797222784:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1790736267.473838:0:5847:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1790736267.473987:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1790736267.474072:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe67ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.474521:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe67ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.474549:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe67ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.474572:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe67ed lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.474580:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe67ed lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.474588:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe67ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.474682:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790736267.474889:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790736267.474897:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe67ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736267.474915:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642173200 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:1.0:1790736267.474920:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe67ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736267.474929:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe67ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736267.474946:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff941605242000) 00010000:00010000:1.0:1790736267.474949:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790736267.474957:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe67ed lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736267.474963:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe67ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736267.474986:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736267.474988:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736267.474989:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790736267.475032:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+17:10429:x1877722797222784:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 3987us (4268us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1790736267.475046:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 20 00000020:00080000:0.0:1790736267.475056:0:5847:0:(tgt_main.c:787:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1790736267.737556:0:12023:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790736267.737569:0:12023:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790736267.737615:0:12023:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1790736267.737622:0:12023:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790736267.853608:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736267.853699:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797223040 00000100:00100000:3.0:1790736267.853713:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797223040 00000100:00100000:3.0:1790736267.853829:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 84 00000100:00100000:3.0:1790736267.853841:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+17:10439:x1877722797223040:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1790736267.853875:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736267.853902:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe67f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526e97 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.854057:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8800/0x6aae200528fe67fb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.854075:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8800/0x6aae200528fe67fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.854090:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8800/0x6aae200528fe67fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790736267.854128:0:8114:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1790736267.854286:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe67f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e97 expref: 20 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.854304:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8800/0x6aae200528fe67fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e97 expref: 19 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736267.854313:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94161505d100) 00010000:00010000:3.0:1790736267.854316:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790736267.854320:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c8800, rc 0) 00000100:00100000:3.0:1790736267.854408:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+19:10439:x1877722797223040:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 569us (875us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1790736267.854424:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 84 00000100:00100000:3.0:1790736267.857196:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736267.857769:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797223168 00000100:00100000:0.0:1790736267.857785:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797223168 00000100:00100000:0.0:1790736267.857912:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 85 00000100:00100000:0.0:1790736267.857926:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163381b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+19:10439:x1877722797223168:12345-192.168.203.5@tcp:34:lfs.0 00010000:00010000:0.0:1790736267.858055:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6809 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.858078:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6809 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.858122:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6809 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.858154:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe6810 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.858164:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe6810 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.858172:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe6810 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.858613:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6817 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.858623:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6817 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.858630:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6817 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790736267.858690:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6817 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.858708:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6809 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.858716:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6809 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.858724:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6809 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.858731:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642173c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736267.858737:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6809 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.858752:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6809 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.858767:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94161505d100) 00010000:00010000:0.0:1790736267.858771:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736267.858778:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6809 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.858785:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6809 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.858802:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe6810 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.858808:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe6810 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.858815:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe6810 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.858821:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642173200 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736267.858824:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe6810 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.858830:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe6810 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.858839:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff941605242500) 00010000:00010000:0.0:1790736267.858841:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736267.858844:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe6810 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.858859:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe6810 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.858880:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6817 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.858887:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6817 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.858893:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6817 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.858898:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642172200 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736267.858901:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6817 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.858907:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6817 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.858915:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff941605242e00) 00010000:00010000:0.0:1790736267.858918:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736267.858920:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6817 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736267.858926:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6817 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736267.859034:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163381b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+19:10439:x1877722797223168:12345-192.168.203.5@tcp:34:lfs.0 Request processed in 1109us (1849us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736267.859045:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 85 00000100:00100000:3.0:1790736267.932231:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736267.932415:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797223424 00000100:00100000:2.0:1790736267.932428:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797223424 00000100:00100000:2.0:1790736267.932501:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 86 00000100:00100000:2.0:1790736267.932514:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163381b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+19:10442:x1877722797223424:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1790736267.932551:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736267.932579:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931800/0x6aae200528fe681e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526e9e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.932683:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe6825 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.932702:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe6825 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.932715:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe6825 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.932732:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe682c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.932739:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe682c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.932746:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe682c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.933140:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe6833 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.933150:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe6833 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.933165:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe6833 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790736267.933180:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1790736267.933331:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe6825 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.933340:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe6825 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.933348:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe6825 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.933354:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941611930c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736267.933360:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe6825 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.933368:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe6825 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.933382:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94161505d100) 00010000:00010000:2.0:1790736267.933386:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790736267.933391:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe6825 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.933397:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe6825 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.933411:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe682c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.933417:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe682c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.933430:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe682c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.933435:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941611931a00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736267.933437:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe682c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.933444:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe682c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.933452:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94160678a500) 00010000:00010000:2.0:1790736267.933454:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790736267.933457:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe682c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.933462:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe682c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.933514:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931800/0x6aae200528fe681e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e9e expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.933540:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe6833 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e9e expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.933547:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94160678a600) 00010000:00010000:2.0:1790736267.933550:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790736267.933553:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611931000, rc 0) 00000100:00100000:2.0:1790736267.933650:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163381b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+21:10442:x1877722797223424:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1139us (1435us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1790736267.933670:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 86 00000100:00100000:2.0:1790736267.940505:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736267.940715:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797223552 00000100:00100000:3.0:1790736267.940729:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797223552 00000100:00100000:3.0:1790736267.940820:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 87 00000100:00100000:3.0:1790736267.940833:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+21:10442:x1877722797223552:12345-192.168.203.5@tcp:54:lfs.0 00010000:00010000:2.0:1790736267.942304:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe6841 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.942337:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe6841 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.942352:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe6841 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.944053:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe6841 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.944074:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe6841 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.944082:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe6841 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.944088:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c8c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736267.944106:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe6841 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.944115:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe6841 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.944134:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94160678a600) 00010000:00010000:2.0:1790736267.944137:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790736267.944142:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe6841 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736267.944161:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe6841 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736267.944303:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+21:10442:x1877722797223552:12345-192.168.203.5@tcp:54:lfs.0 Request processed in 3464us (3803us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736267.944315:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 87 00000100:00100000:1.0:1790736267.956000:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736267.956251:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797223808 00000100:00100000:0.0:1790736267.956267:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797223808 00000100:00100000:0.0:1790736267.956372:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 21 00000100:00100000:0.0:1790736267.956386:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416114ed450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+21:10442:x1877722797223808:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:0.0:1790736267.957130:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416114ed450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+22:10442:x1877722797223808:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 708us (1107us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1790736267.957141:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 21 00000100:00100000:2.0:1790736268.004557:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736268.005648:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797224064 00000100:00100000:3.0:1790736268.005668:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797224064 00000100:00100000:3.0:1790736268.006799:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 88 00000100:00100000:3.0:1790736268.006814:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+22:9971:x1877722797224064:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:3.0:1790736268.006849:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736268.006874:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe6848 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526ea5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.007023:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe684f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.007042:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe6833 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e9e expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.007054:0:5843:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe684f lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.007121:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe6833 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e9e expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.007138:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe6833 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e9e expref: 23 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736268.007157:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163381b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1877722816120704:192.168.203.5@tcp:104: 00000100:00100000:3.0:1790736268.007303:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162a685f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790736268.015969:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00080000:2.0:1790736268.018540:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790736268.019318:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163381b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1877722816120704:192.168.203.5@tcp:104: 00010000:00010000:3.0:1790736268.019359:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe684f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736268.020376:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797224192 00000100:00100000:3.0:1790736268.020394:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797224192 00010000:00010000:3.0:1790736268.023762:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe6833 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e9e expref: 24 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736268.023838:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 47 00000100:00100000:3.0:1790736268.023850:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c521880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+24:2356:x1877722797224192:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790736268.023876:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790736268.023885:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe6833 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e9e expref: 24 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.023902:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe6833 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e9e expref: 24 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.023947:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe6833 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526e9e expref: 24 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.023968:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94160678a600) 00010000:00010000:3.0:1790736268.023975:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe684f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.023987:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe684f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.024011:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe684f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.024045:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790736268.024179:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c521880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+23:2356:x1877722797224192:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 324us (8219us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736268.024188:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 47 00010000:00010000:3.0:1790736268.024506:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe684f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.024516:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe684f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790736268.024561:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1790736268.024794:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe6848 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526ea5 expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.024823:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe684f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526ea5 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.024832:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94160678a600) 00010000:00010000:3.0:1790736268.024835:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790736268.024838:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c8c00, rc 0) 00000100:00100000:3.0:1790736268.024889:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+23:9971:x1877722797224064:12345-192.168.203.5@tcp:101:bash.0 Request processed in 18080us (20360us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1790736268.024898:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 88 00000100:00100000:2.0:1790736268.037796:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736268.037852:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797224448 00000100:00100000:2.0:1790736268.037866:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797224448 00000100:00100000:2.0:1790736268.037936:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 89 00000100:00100000:2.0:1790736268.037947:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+23:9971:x1877722797224448:12345-192.168.203.5@tcp:36:bash.0 00010000:00010000:2.0:1790736268.038359:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe685d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.038386:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe685d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.038413:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe685d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790736268.038484:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1790736268.038513:0:5845:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005c6e00a2 reply state 0000000077f5cd75 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe685d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736268.038524:0:5845:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1790736268.038618:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1790736268.038762:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+27:9971:x1877722797224448:12345-192.168.203.5@tcp:36:bash.0 Request processed in 816us (980us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1790736268.038777:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 89 00000020:00080000:2.0:1790736268.038784:0:5845:0:(tgt_main.c:787:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1790736268.045011:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736268.045068:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797224576 00000100:00100000:2.0:1790736268.045082:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797224576 00000100:00100000:2.0:1790736268.045188:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 90 00000100:00100000:2.0:1790736268.045200:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+27:9971:x1877722797224576:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:2.0:1790736268.045240:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736268.045275:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe6864 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526eac expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.045371:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe6864 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526eac expref: 28 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.045511:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe685d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.045553:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe685d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.045562:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe685d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.045570:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941611931a00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736268.045577:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe685d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.045588:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe685d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.045607:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94160678a600) 00010000:00010000:3.0:1790736268.045610:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736268.045617:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe685d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.045623:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe685d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.046506:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe6864 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526eac expref: 27 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.047517:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94160678a600) 00010000:00010000:2.0:1790736268.047526:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790736268.047540:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611930c00, rc 0) 00000100:00100000:2.0:1790736268.047651:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+27:9971:x1877722797224576:12345-192.168.203.5@tcp:101:bash.0 Request processed in 2448us (2653us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736268.047663:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 90 00000100:00100000:2.0:1790736268.050087:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736268.057701:0:8632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797224704 00000100:00100000:3.0:1790736268.057732:0:8632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797224704 00010000:00010000:0.0:1790736268.059764:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790736268.061060:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 33 00000100:00100000:2.0:1790736268.061079:0:8632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+6:9971:x1877722797224704:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:2.0:1790736268.061145:0:8632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736268.061188:0:8632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a669fd82/0x6aae200528fe686b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526eb3 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790736268.061235:0:8632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6abc778a, atime: 0x6abc7789, ctime: 0x6abc778a, blocks: 0xb 00010000:00010000:2.0:1790736268.061274:0:8632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=340s v=(0 0) 00010000:00010000:2.0:1790736268.061280:0:8632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790736268.061294:0:8632:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a669fd82/0x6aae200528fe686b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.5@tcp remote: 0x92962417a526eb3 expref: 7 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.061323:0:8632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a669fd82/0x6aae200528fe686b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.5@tcp remote: 0x92962417a526eb3 expref: 7 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.061342:0:8632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611931c00, rc 0) 00000100:00080000:1.0:1790736268.061668:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790736268.061897:0:8632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+7:9971:x1877722797224704:12345-192.168.203.5@tcp:101:bash.0 Request processed in 820us (11822us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736268.061906:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 33 00000100:00100000:0.0:1790736268.076078:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736268.076198:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797224832 00000100:00100000:3.0:1790736268.076212:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797224832 00002000:00010000:3.0:1790736268.076507:0:6703:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1790736268.076514:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94163c522a00 with x1877722797224832 ext(0->18446744073709551615) 00002000:00010000:3.0:1790736268.076541:0:6703:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94163c522a00. 00000100:00100000:3.0:1790736268.076706:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1 00000100:00100000:3.0:1790736268.076718:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+7:2356:x1877722797224832:12345-192.168.203.5@tcp:10:bash.0 00002000:00010000:3.0:1790736268.077508:0:6703:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1790736268.077516:0:6703:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1790736266 -> 1790736268 00002000:00010000:3.0:1790736268.077520:0:6703:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1790736265 -> 1790736265 00002000:00010000:3.0:1790736268.077522:0:6703:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1790736266 -> 1790736268 00002000:00010000:3.0:1790736268.077524:0:6703:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1790736268.077748:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+8:2356:x1877722797224832:12345-192.168.203.5@tcp:10:bash.0 Request processed in 1025us (1677us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1790736268.077761:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1 00002000:00010000:3.0:1790736268.077766:0:6703:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1790736268.077769:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94163c522a00 with x1877722797224832 ext(0->18446744073709551615) 00002000:00010000:3.0:1790736268.077776:0:6703:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94163c522a00. 00000100:00100000:1.0:1790736268.182983:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736268.184299:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797224960 00000100:00100000:2.0:1790736268.184324:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797224960 00000100:00100000:2.0:1790736268.184455:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 91 00000100:00100000:2.0:1790736268.184468:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+27:10456:x1877722797224960:12345-192.168.203.5@tcp:34:lfs.0 00010000:00010000:2.0:1790736268.184580:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6872 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.184604:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6872 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.184648:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6872 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.184673:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe6879 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.184682:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe6879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.184690:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe6879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.185657:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe6880 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.185674:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe6880 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.185683:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe6880 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790736268.185744:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe6880 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.185759:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6872 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.185767:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6872 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.185775:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6872 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.185794:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941611930400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736268.185799:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6872 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.185808:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6872 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.185823:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94161505d100) 00010000:00010000:2.0:1790736268.185826:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790736268.185832:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6872 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.185914:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6872 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.185935:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe6879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.185942:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe6879 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.185949:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe6879 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.185954:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941611931600 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736268.185957:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe6879 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.185965:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe6879 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.185984:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94160678ab00) 00010000:00010000:2.0:1790736268.185987:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790736268.185990:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe6879 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.185997:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe6879 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.186014:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe6880 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.186021:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe6880 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.186027:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe6880 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.186032:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941611931a00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736268.186035:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe6880 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.186040:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe6880 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.186047:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94160678a600) 00010000:00010000:2.0:1790736268.186050:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790736268.186053:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe6880 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.186059:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe6880 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736268.187215:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+27:10456:x1877722797224960:12345-192.168.203.5@tcp:34:lfs.0 Request processed in 2735us (4234us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736268.187229:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 91 00000100:00100000:2.0:1790736268.234839:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736268.234962:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797225216 00000100:00100000:3.0:1790736268.234975:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797225216 00000100:00100000:3.0:1790736268.235046:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 92 00000100:00100000:3.0:1790736268.235058:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+27:10459:x1877722797225216:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1790736268.235088:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736268.235167:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe6887 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526eba expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.235276:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe688e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.235294:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe688e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.235307:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe688e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.235348:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6895 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.235356:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6895 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.235363:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6895 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.235742:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe689c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.235752:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe689c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.235759:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe689c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790736268.235770:0:8114:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1790736268.235894:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe688e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.235902:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe688e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.235911:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe688e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.235917:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c8e00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736268.235923:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe688e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.235945:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe688e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.235961:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94161505d100) 00010000:00010000:3.0:1790736268.235964:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736268.235972:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe688e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.235979:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe688e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.235996:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6895 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.236002:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6895 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.236008:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6895 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.236013:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c9c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736268.236016:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6895 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.236022:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6895 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.236029:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94161505de00) 00010000:00010000:3.0:1790736268.236032:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736268.236035:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6895 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.236051:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6895 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.236165:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe6887 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526eba expref: 30 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.236181:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe689c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526eba expref: 29 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.236189:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94160678a600) 00010000:00010000:3.0:1790736268.236191:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790736268.236194:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c9800, rc 0) 00000100:00100000:3.0:1790736268.236275:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+29:10459:x1877722797225216:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1220us (1452us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1790736268.236284:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 92 00000100:00100000:1.0:1790736268.247325:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736268.247453:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797225344 00000100:00100000:3.0:1790736268.247469:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797225344 00000100:00100000:3.0:1790736268.247556:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 93 00000100:00100000:3.0:1790736268.247568:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+29:10459:x1877722797225344:12345-192.168.203.5@tcp:54:lfs.0 00010000:00010000:3.0:1790736268.247658:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe68aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.247681:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe684f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526ea5 expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.247693:0:5844:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe68aa lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.247758:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe684f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0x92962417a526ea5 expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.247774:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe684f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526ea5 expref: 29 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736268.247792:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163381b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1877722816120832:192.168.203.5@tcp:104: 00000100:00100000:3.0:1790736268.247929:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162a685e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790736268.256633:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736268.256978:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797225600 00000100:00100000:0.0:1790736268.256993:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797225600 00000100:00100000:0.0:1790736268.257090:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 22 00000100:00100000:0.0:1790736268.257167:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+30:5592:x1877722797225600:12345-192.168.203.5@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1790736268.257691:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+31:5592:x1877722797225600:12345-192.168.203.5@tcp:35:ldlm_bl.0 Request processed in 527us (1077us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1790736268.257701:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 22 00000100:00100000:3.0:1790736268.257891:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163381b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1877722816120832:192.168.203.5@tcp:104: 00010000:00010000:3.0:1790736268.257933:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe68aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736268.264470:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736268.264705:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797225728 00000100:00100000:3.0:1790736268.264721:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797225728 00010000:00010000:3.0:1790736268.264786:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe684f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526ea5 expref: 31 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736268.264841:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 48 00000100:00100000:3.0:1790736268.264853:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c521c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+31:2356:x1877722797225728:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790736268.264875:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790736268.264882:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe684f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526ea5 expref: 31 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.264899:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe684f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526ea5 expref: 31 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.264958:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe684f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526ea5 expref: 31 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.264981:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94160678a600) 00010000:00010000:3.0:1790736268.264988:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe68aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.265001:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe68aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.265012:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe68aa lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.265054:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790736268.265240:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe68aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.265252:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe68aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.265303:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe68aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.265313:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe68aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.265321:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe68aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.265327:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c9c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736268.265334:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe68aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.265343:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe68aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.265353:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94160678a600) 00010000:00010000:2.0:1790736268.265357:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790736268.265361:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe68aa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.265392:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe68aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736268.265573:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c521c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+30:2356:x1877722797225728:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 719us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736268.265583:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 48 00000100:00100000:2.0:1790736268.267328:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+29:10459:x1877722797225344:12345-192.168.203.5@tcp:54:lfs.0 Request processed in 19748us (20004us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736268.267864:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 93 00000100:00100000:2.0:1790736268.270620:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736268.270699:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797225984 00000100:00100000:0.0:1790736268.270712:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797225984 00000100:00100000:0.0:1790736268.270809:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 23 00000100:00100000:0.0:1790736268.270820:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+29:10459:x1877722797225984:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:0.0:1790736268.271192:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+30:10459:x1877722797225984:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 371us (583us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1790736268.271202:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 23 00000100:00100000:0.0:1790736268.364859:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736268.365229:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797226240 00000100:00100000:3.0:1790736268.365244:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797226240 00000100:00100000:3.0:1790736268.365330:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 94 00000100:00100000:3.0:1790736268.365342:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+30:10470:x1877722797226240:12345-192.168.203.5@tcp:101:cat.0 00010000:00010000:3.0:1790736268.365379:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736268.365418:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe68b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526ec1 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.365517:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe68b8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.365560:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe68b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.365575:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe68b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.365595:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe68bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.365603:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe68bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.365610:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe68bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.365922:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9000/0x6aae200528fe68c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.365931:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9000/0x6aae200528fe68c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.365938:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9000/0x6aae200528fe68c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790736268.365948:0:8114:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1790736268.366339:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe68b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.366351:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe68b8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.366358:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe68b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.366371:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c8400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736268.366376:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe68b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.366558:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe68b8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.366574:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94161505d100) 00010000:00010000:3.0:1790736268.366577:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736268.366584:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe68b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.366591:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe68b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.366607:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe68bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.366614:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe68bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.366620:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe68bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.366625:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c8e00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736268.366628:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe68bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.366635:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe68bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.366653:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94161505de00) 00010000:00010000:3.0:1790736268.366656:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736268.366659:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe68bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.366665:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe68bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.366730:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe68b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526ec1 expref: 33 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.366745:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9000/0x6aae200528fe68c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526ec1 expref: 32 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.366753:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94160678a600) 00010000:00010000:3.0:1790736268.366756:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790736268.366758:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c9000, rc 0) 00000100:00100000:3.0:1790736268.366856:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+32:10470:x1877722797226240:12345-192.168.203.5@tcp:101:cat.0 Request processed in 1515us (2010us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1790736268.366866:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 94 00000100:00100000:2.0:1790736268.375807:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736268.375977:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797226496 00000100:00100000:1.0:1790736268.375992:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797226496 00000100:00100000:1.0:1790736268.376066:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 24 00000100:00100000:1.0:1790736268.376085:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+32:10470:x1877722797226496:12345-192.168.203.5@tcp:35:cat.0 00000100:00100000:1.0:1790736268.376487:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+33:10470:x1877722797226496:12345-192.168.203.5@tcp:35:cat.0 Request processed in 410us (693us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1790736268.376524:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 24 00000100:00100000:2.0:1790736268.408025:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736268.408323:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797226752 00000100:00100000:0.0:1790736268.408350:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797226752 00000100:00100000:0.0:1790736268.408438:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 95 00000100:00100000:0.0:1790736268.408450:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+33:10471:x1877722797226752:12345-192.168.203.5@tcp:36:rm.0 00010000:00010000:0.0:1790736268.408762:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1790736268.408800:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9000/0x6aae200528fe68c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526ec1 expref: 33 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736268.408832:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe689c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526eba expref: 32 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736268.408847:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe6864 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526eac expref: 31 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736268.408860:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94160678a600) 00010000:00010000:0.0:1790736268.408875:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790736268.408909:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe68d4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736268.408927:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe68d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736268.408940:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe68d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736268.408959:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe68db lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736268.408967:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe68db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736268.408999:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe68db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736268.409781:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe68e2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736268.409795:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe68e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736268.409804:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe68e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790736268.412757:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1790736268.412823:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 340423727851ns, next at 341423721751ns, rc = 0 00010000:00010000:1.0:1790736268.412930:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe68e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.412950:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe68e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.412963:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe68e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.412973:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe68e9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.412980:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe68e9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.412986:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe68e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.413512:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790736268.413766:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe68e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.413783:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe68e2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.413791:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe68e2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.413797:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642173c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736268.413816:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe68e2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.413825:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe68e2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.413840:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff941605242500) 00010000:00010000:1.0:1790736268.413843:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1790736268.413849:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe68e2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.413856:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe68e2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.413881:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe68d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.413887:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe68d4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.413893:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe68d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.413898:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642173e00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736268.413900:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe68d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.413906:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe68d4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.413912:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94161505d100) 00010000:00010000:1.0:1790736268.413914:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736268.413921:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe68d4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.413927:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe68d4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790736268.413938:0:5845:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000079868655 reply state 00000000c66f3c32 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe68db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736268.414032:0:5845:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790736268.414318:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+32:10471:x1877722797226752:12345-192.168.203.5@tcp:36:rm.0 Request processed in 5865us (6306us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1790736268.414329:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 95 00010000:00010000:0.0:1790736268.414509:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790736268.414518:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe68e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736268.414535:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c61800 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:0.0:1790736268.414538:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe68e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736268.414609:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe68e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736268.414622:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff941605242500) 00010000:00010000:0.0:1790736268.414624:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790736268.414627:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe68e9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736268.414633:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe68e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736268.414671:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736268.414673:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736268.414675:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790736268.437372:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790736268.437409:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816120960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790736268.437505:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736268.437628:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816120960 00000100:00100000:0.0:1790736268.437639:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816120960 00000100:00100000:0.0:1790736268.437699:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790736268.437711:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1877722816120960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790736268.437763:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790736268.437817:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1877722816120960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736268.437824:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790736268.437878:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816120960:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790736268.438765:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe68db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.438786:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe68db lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.438795:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe68db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.438830:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642173600 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736268.438837:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe68db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.438846:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe68db lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.438866:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff941605242e00) 00010000:00010000:3.0:1790736268.438870:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736268.438876:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe68db lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.438883:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe68db lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736268.479336:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736268.479495:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797227008 00000100:00100000:3.0:1790736268.479508:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797227008 00000100:00100000:3.0:1790736268.479588:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 96 00000100:00100000:3.0:1790736268.479599:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+31:10477:x1877722797227008:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:3.0:1790736268.479632:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736268.479660:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe68f0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526ec8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.479811:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe68f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.479829:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe68f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.479841:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe68f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.479877:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe68fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.479885:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe68fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.479891:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe68fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790736268.480840:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1790736268.481737:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6905 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.481760:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6905 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.481774:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6905 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.481828:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe68f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.481837:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe68f7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.481843:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe68f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.481850:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c8e00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736268.481855:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe68f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.481881:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe68f7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.481894:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94161505d100) 00010000:00010000:3.0:1790736268.481897:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736268.481903:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe68f7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.481909:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe68f7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790736268.481927:0:5843:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d6442a52 reply state 00000000af4ac110 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe68fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736268.481938:0:5843:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790736268.481986:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe68f0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526ec8 expref: 34 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.482003:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6905 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526ec8 expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.482010:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94161505dc00) 00010000:00010000:3.0:1790736268.482012:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790736268.482015:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c9a00, rc 0) 00000100:00100000:3.0:1790736268.482180:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+34:10477:x1877722797227008:12345-192.168.203.5@tcp:101:bash.0 Request processed in 2581us (2855us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1790736268.482191:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 96 00010000:00010000:3.0:1790736268.485256:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe68fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.485307:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe68fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.485316:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe68fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.485322:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c8400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736268.485328:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe68fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.485336:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe68fe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.485358:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94161505de00) 00010000:00010000:3.0:1790736268.485362:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736268.485368:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe68fe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.485374:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe68fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736268.489452:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736268.493289:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797227136 00000100:00100000:1.0:1790736268.493311:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797227136 00000100:00100000:1.0:1790736268.494171:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 34 00000100:00100000:1.0:1790736268.494188:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+7:2355:x1877722797227136:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:1.0:1790736268.494214:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736268.494242:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000082e00f7/0x6aae200528fe6913 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526ecf expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790736268.494275:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790736268.494302:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=340s v=(0 0) 00010000:00010000:1.0:1790736268.494306:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790736268.494318:0:6699:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000082e00f7/0x6aae200528fe6913 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526ecf expref: 8 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.494340:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000082e00f7/0x6aae200528fe6913 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526ecf expref: 8 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.494378:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c61400, rc 0) 00000100:00100000:1.0:1790736268.494607:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+8:2355:x1877722797227136:12345-192.168.203.5@tcp:101:bash.0 Request processed in 358us (5101us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736268.494618:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 34 00000100:00080000:3.0:1790736268.496795:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790736268.498899:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736268.499129:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797227264 00000100:00100000:1.0:1790736268.499144:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797227264 00000100:00100000:1.0:1790736268.499263:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 35 00000100:00100000:1.0:1790736268.499275:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+8:10477:x1877722797227264:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:1.0:1790736268.499301:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736268.499329:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000193ba413/0x6aae200528fe691a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526ed6 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.499374:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000082e00f7/0x6aae200528fe6913 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526ecf expref: 9 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.499396:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790736268.499401:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790736268.499407:0:6697:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000193ba413/0x6aae200528fe691a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526ed6 expref: 9 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.499452:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000082e00f7/0x6aae200528fe6913 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0x92962417a526ecf expref: 9 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.499470:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000082e00f7/0x6aae200528fe6913 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526ecf expref: 9 pid: 6699 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736268.499506:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941635cfad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6697:1877722816121088:192.168.203.5@tcp:104: 00000100:00100000:1.0:1790736268.499651:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607c03600 going to sleep for 11 seconds 00000040:00080000:0.0:1790736268.501772:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790736268.501783:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790736268.501815:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1790736268.501822:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790736268.502924:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941635cfad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6697:1877722816121088:192.168.203.5@tcp:104: 00010000:00010000:3.0:1790736268.502976:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000193ba413/0x6aae200528fe691a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0x92962417a526ed6 expref: 9 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.503003:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c60e00, rc 0) 00000100:00100000:3.0:1790736268.503086:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+9:10477:x1877722797227264:12345-192.168.203.5@tcp:101:bash.0 Request processed in 3808us (4196us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736268.503151:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 35 00000100:00100000:2.0:1790736268.505469:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736268.505616:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797227392 00000100:00100000:3.0:1790736268.505632:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797227392 00010000:00010000:3.0:1790736268.505697:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000082e00f7/0x6aae200528fe6913 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526ecf expref: 9 pid: 6699 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736268.505810:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 49 00000100:00100000:3.0:1790736268.505821:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160557dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+9:2355:x1877722797227392:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790736268.505844:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790736268.505878:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000082e00f7/0x6aae200528fe6913 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526ecf expref: 9 pid: 6699 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.505896:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000082e00f7/0x6aae200528fe6913 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526ecf expref: 9 pid: 6699 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.505929:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000082e00f7/0x6aae200528fe6913 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526ecf expref: 9 pid: 6699 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.505954:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790736268.505959:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790736268.505971:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000193ba413/0x6aae200528fe691a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0x92962417a526ed6 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.505984:0:5829:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000193ba413/0x6aae200528fe691a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0x92962417a526ed6 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.506235:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000193ba413/0x6aae200528fe691a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0x92962417a526ed6 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736268.506254:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163381b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5829:1877722816121216:192.168.203.5@tcp:105: 00000100:00100000:3.0:1790736268.506379:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162a685e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790736268.510017:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736268.510302:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797227648 00000100:00100000:2.0:1790736268.510318:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797227648 00000100:00100000:2.0:1790736268.510404:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 25 00000100:00100000:2.0:1790736268.510417:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+33:10477:x1877722797227648:12345-192.168.203.5@tcp:35:bash.0 00000100:00100000:2.0:1790736268.510946:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+34:10477:x1877722797227648:12345-192.168.203.5@tcp:35:bash.0 Request processed in 530us (941us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1790736268.510955:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 25 00000100:00100000:1.0:1790736268.514213:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163381b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5829:1877722816121216:192.168.203.5@tcp:105: 00010000:00010000:1.0:1790736268.514264:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790736268.514370:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160557dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+8:2355:x1877722797227392:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 8549us (8915us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736268.514392:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 49 00000100:00100000:3.0:1790736268.661016:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736268.661224:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797227776 00000100:00100000:2.0:1790736268.661237:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797227776 00000100:00100000:2.0:1790736268.661325:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 97 00000100:00100000:2.0:1790736268.661349:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+34:10493:x1877722797227776:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1790736268.661387:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736268.661420:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe6921 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526edd expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.661540:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe6928 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.661703:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe6928 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.661717:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe6928 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790736268.661764:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1790736268.661769:0:5844:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790736268.661793:0:5844:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe6928 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.661830:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe6921 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526edd expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.661856:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe6928 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526edd expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.661867:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94161505d100) 00010000:00010000:2.0:1790736268.661870:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790736268.661875:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611931a00, rc 0) 00000100:00100000:2.0:1790736268.662220:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+35:10493:x1877722797227776:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 882us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736268.662230:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 97 00000100:00100000:2.0:1790736268.673158:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736268.673279:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797228032 00000100:00100000:3.0:1790736268.673296:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797228032 00000100:00100000:3.0:1790736268.673389:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 98 00000100:00100000:3.0:1790736268.673401:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+35:10493:x1877722797228032:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1790736268.673438:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736268.673468:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe692f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526ee4 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.673627:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe6936 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.673648:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe6936 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.673664:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe6936 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790736268.673681:0:8114:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1790736268.673872:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe692f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526ee4 expref: 38 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.673927:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe6936 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526ee4 expref: 37 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.673939:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94161505dc00) 00010000:00010000:3.0:1790736268.673943:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790736268.673948:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c8c00, rc 0) 00000100:00100000:3.0:1790736268.674029:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+37:10493:x1877722797228032:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 630us (890us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1790736268.674038:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 98 00000100:00100000:3.0:1790736268.679235:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736268.679636:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797228288 00000100:00100000:1.0:1790736268.679655:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797228288 00000100:00100000:1.0:1790736268.679735:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 99 00000100:00100000:1.0:1790736268.679747:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+37:10493:x1877722797228288:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1790736268.679781:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736268.679809:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6944 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526eeb expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.679948:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe694b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.679966:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe694b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.679980:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe694b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790736268.679996:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1790736268.680198:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6944 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526eeb expref: 40 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.680241:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe694b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526eeb expref: 39 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.680252:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94161505dc00) 00010000:00010000:1.0:1790736268.680256:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790736268.680260:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c60800, rc 0) 00000100:00100000:1.0:1790736268.680522:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+39:10493:x1877722797228288:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 775us (1300us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1790736268.680539:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 99 00000100:00100000:0.0:1790736268.684235:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736268.684568:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797228416 00000100:00100000:1.0:1790736268.684583:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797228416 00000100:00100000:1.0:1790736268.684679:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6 00000100:00100000:1.0:1790736268.684691:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+39:2353:x1877722797228416:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790736268.684710:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736268.684740:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe6936 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526ee4 expref: 39 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.684764:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94161505dc00) 00010000:00010000:1.0:1790736268.684770:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790736268.684824:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+38:2353:x1877722797228416:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 136us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736268.684832:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6 00000100:00100000:3.0:1790736268.690955:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736268.691298:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797228544 00000100:00100000:1.0:1790736268.691314:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797228544 00000100:00100000:1.0:1790736268.691418:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 36 00000100:00100000:1.0:1790736268.691432:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+8:2355:x1877722797228544:12345-192.168.203.5@tcp:1:lfs.0 00010000:00010000:1.0:1790736268.691516:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7b57fcc/0x6aae200528fe6959 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.691560:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000193ba413/0x6aae200528fe691a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0x92962417a526ed6 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.691570:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790736268.691576:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790736268.691581:0:6699:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7b57fcc/0x6aae200528fe6959 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.691630:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000193ba413/0x6aae200528fe691a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.5@tcp remote: 0x92962417a526ed6 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.691650:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000193ba413/0x6aae200528fe691a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a526ed6 expref: 8 pid: 6697 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736268.691671:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941635cf8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6699:1877722816121344:192.168.203.5@tcp:104: 00000100:00100000:1.0:1790736268.691811:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607c033c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790736268.694223:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941635cf8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6699:1877722816121344:192.168.203.5@tcp:104: 00010000:00010000:1.0:1790736268.694262:0:6699:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c7b57fcc/0x6aae200528fe6959 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736268.695883:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736268.695983:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797228672 00000100:00100000:2.0:1790736268.696012:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797228672 00002000:00100000:2.0:1790736268.696147:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff94163ae38380 x1877722797228672/t0(0) o4->f945944d-9086-46a2-a91c-8bc7b88e8918@192.168.203.5@tcp:99/0 lens 504/0 e 0 to 0 dl 1790736279 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790736268.696160:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94163ae38380 with x1877722797228672 ext(0->8) 00010000:00010000:2.0:1790736268.696172:0:6705:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000193ba413/0x6aae200528fe691a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a526ed6 expref: 9 pid: 6697 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.696192:0:6705:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000193ba413/0x6aae200528fe691a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a526ed6 expref: 9 pid: 6697 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790736268.696201:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff94163ae38380 00000100:00100000:2.0:1790736268.696230:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1 00000100:00100000:2.0:1790736268.696242:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+9:2356:x1877722797228672:12345-192.168.203.5@tcp:4:lfs.0 00000100:00100000:2.0:1790736268.696876:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+11:2356:x1877722797228672:12345-192.168.203.5@tcp:4:lfs.0 Request processed in 630us (1002us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1790736268.696886:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1 00002000:00100000:2.0:1790736268.696897:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff94163ae38380 x1877722797228672/t4294967302(0) o4->f945944d-9086-46a2-a91c-8bc7b88e8918@192.168.203.5@tcp:99/0 lens 504/448 e 0 to 0 dl 1790736279 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790736268.696906:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94163ae38380 with x1877722797228672 ext(0->8) 00010000:00010000:2.0:1790736268.696915:0:6705:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000193ba413/0x6aae200528fe691a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a526ed6 expref: 11 pid: 6697 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.696931:0:6705:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000193ba413/0x6aae200528fe691a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a526ed6 expref: 11 pid: 6697 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790736268.696939:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff94163ae38380 00000100:00100000:3.0:1790736268.700422:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736268.700556:0:8527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797228800 00000100:00100000:0.0:1790736268.700569:0:8527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797228800 00010000:00010000:0.0:1790736268.700625:0:8527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000193ba413/0x6aae200528fe691a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a526ed6 expref: 11 pid: 6697 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736268.700676:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 50 00000100:00100000:0.0:1790736268.700687:0:8527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+11:2355:x1877722797228800:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790736268.700725:0:8527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1790736268.700751:0:8527:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1790736268.700754:0:8527:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1790736268 00002000:00010000:0.0:1790736268.700756:0:8527:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1790736269 00002000:00010000:0.0:1790736268.700759:0:8527:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1790736268 00010000:00010000:0.0:1790736268.700766:0:8527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000193ba413/0x6aae200528fe691a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a526ed6 expref: 11 pid: 6697 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736268.700783:0:8527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000193ba413/0x6aae200528fe691a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a526ed6 expref: 11 pid: 6697 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736268.700814:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000193ba413/0x6aae200528fe691a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.5@tcp remote: 0x92962417a526ed6 expref: 11 pid: 6697 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736268.700835:0:8527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790736268.700840:0:8527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790736268.700848:0:8527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7b57fcc/0x6aae200528fe6959 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736268.700858:0:8527:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7b57fcc/0x6aae200528fe6959 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736268.701046:0:8527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790736268.701171:0:8527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+10:2355:x1877722797228800:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 484us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736268.701181:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 50 00010000:00010000:2.0:1790736268.702965:0:6699:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c7b57fcc/0x6aae200528fe6959 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.702992:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7b57fcc/0x6aae200528fe6959 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.703049:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7b57fcc/0x6aae200528fe6959 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.703060:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7b57fcc/0x6aae200528fe6959 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.703070:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7b57fcc/0x6aae200528fe6959 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.703088:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60400 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:2.0:1790736268.703112:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7b57fcc/0x6aae200528fe6959 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.703124:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7b57fcc/0x6aae200528fe6959 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.703151:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7b57fcc/0x6aae200528fe6959 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.703160:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7b57fcc/0x6aae200528fe6959 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736268.703692:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+9:2355:x1877722797228544:12345-192.168.203.5@tcp:1:lfs.0 Request processed in 12111us (12602us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736268.703706:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 36 00000100:00100000:3.0:1790736268.707591:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736268.707679:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797229056 00000100:00100000:2.0:1790736268.707694:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797229056 00000100:00100000:2.0:1790736268.707760:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 26 00000100:00100000:2.0:1790736268.707771:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416114ee450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+38:10493:x1877722797229056:12345-192.168.203.5@tcp:35:lfs.0 00000004:00010000:2.0:1790736268.707854:0:5847:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe694b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526eeb expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790736268.708249:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1790736268.708300:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1790736268.708722:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1790736268.708784:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe6960 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.708804:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6905 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526ec8 expref: 42 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.708814:0:5847:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe6960 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.708860:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6905 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0x92962417a526ec8 expref: 42 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.708880:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6905 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526ec8 expref: 42 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736268.708921:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f7f7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5847:1877722816121472:192.168.203.5@tcp:104: 00000100:00100000:2.0:1790736268.709046:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162f7d73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790736268.712241:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f7f7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5847:1877722816121472:192.168.203.5@tcp:104: 00010000:00010000:1.0:1790736268.712281:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe6960 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736268.712868:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736268.713472:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797229184 00000100:00100000:1.0:1790736268.713484:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797229184 00010000:00010000:1.0:1790736268.713601:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6905 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526ec8 expref: 43 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736268.713695:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 51 00000100:00100000:1.0:1790736268.713708:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+43:2355:x1877722797229184:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790736268.713731:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736268.713739:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6905 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526ec8 expref: 43 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.713756:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6905 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526ec8 expref: 43 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.713784:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6905 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526ec8 expref: 43 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.713806:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94161505dc00) 00010000:00010000:1.0:1790736268.713812:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe6960 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.713824:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe6960 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.713832:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe6960 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.713871:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790736268.713973:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+42:2355:x1877722797229184:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 266us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736268.713982:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 51 00010000:00010000:3.0:1790736268.714053:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe6960 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.714063:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe6960 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790736268.714297:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1790736268.714616:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1790736268.714756:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163ae3b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1877722816121600:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790736268.714824:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736268.714865:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162a685b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790736268.714948:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816121600 00000100:00100000:0.0:1790736268.714956:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816121600 00000100:00100000:0.0:1790736268.715018:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790736268.715026:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5847:x1877722816121600:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790736268.715140:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5847:x1877722816121600:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 115us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736268.715148:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790736268.715539:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163ae3b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1877722816121600:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1790736268.716068:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00080000:0.0:1790736268.716932:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790736268.717209:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163ae3b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1877722816121728:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790736268.717286:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736268.717379:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162a6856c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790736268.717711:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816121728 00000100:00100000:0.0:1790736268.717720:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816121728 00000100:00100000:0.0:1790736268.718003:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790736268.718015:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5847:x1877722816121728:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790736268.718650:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5847:x1877722816121728:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 329us (1055us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1790736268.718661:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790736268.718770:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163ae3b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1877722816121728:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1790736268.718860:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1790736268.718913:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe6960 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.718926:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe6960 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.718935:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe6960 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.718942:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941611931600 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736268.718948:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe6960 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.718958:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe6960 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.718978:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94161505dc00) 00010000:00010000:3.0:1790736268.718981:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1790736268.718987:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe6960 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.718994:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe6960 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790736268.719293:0:5847:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1790736268.719777:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1790736268.719795:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 340730699871ns, next at 341730696853ns, rc = 0 00000001:00080000:3.0:1790736268.719803:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1790736268.719849:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94161505dc00) 00010000:00010000:3.0:1790736268.719853:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790736268.719862:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe694b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526eeb expref: 46 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736268.720016:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416114ee450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+45:10493:x1877722797229056:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 12245us (12439us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1790736268.720026:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 26 00000020:00080000:3.0:1790736268.720032:0:5847:0:(tgt_main.c:787:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1790736268.722737:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736268.722868:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797229312 00000100:00100000:1.0:1790736268.722881:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797229312 00000100:00100000:1.0:1790736268.722953:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 100 00000100:00100000:1.0:1790736268.722965:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+45:10493:x1877722797229312:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1790736268.723004:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736268.723039:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6967 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526ef2 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.723168:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6967 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526ef2 expref: 46 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.723187:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6967 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526ef2 expref: 46 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736268.723212:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff941603253d00) 00010000:00010000:1.0:1790736268.723216:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790736268.723221:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c60600, rc 0) 00000100:00100000:1.0:1790736268.723311:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+46:10493:x1877722797229312:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 348us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736268.723319:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 100 00000100:00100000:1.0:1790736268.726640:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736268.726760:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797229568 00000100:00100000:3.0:1790736268.726773:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797229568 00000100:00100000:3.0:1790736268.726848:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 27 00000100:00100000:3.0:1790736268.726860:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+46:10493:x1877722797229568:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:3.0:1790736268.727212:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+47:10493:x1877722797229568:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 353us (585us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1790736268.727221:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 27 00000100:00100000:1.0:1790736268.823876:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736268.824057:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797229696 00000100:00100000:2.0:1790736268.824071:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797229696 00000100:00100000:2.0:1790736268.824188:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 101 00000100:00100000:2.0:1790736268.824200:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+47:10503:x1877722797229696:12345-192.168.203.5@tcp:34:lfs.0 00010000:00010000:2.0:1790736268.824306:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe696e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.824332:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe696e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.824345:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe696e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.824363:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6975 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.824371:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.824387:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.824853:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe697c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.824864:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe697c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.824888:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe697c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790736268.825021:0:5844:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe697c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.825037:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe696e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.825044:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe696e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.825052:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe696e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.825059:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941611931600 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736268.825064:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe696e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.825072:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe696e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.825251:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94161505d100) 00010000:00010000:2.0:1790736268.825255:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790736268.825673:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe696e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.825684:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe696e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.825702:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.825719:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6975 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.825726:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6975 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.825731:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941611930400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736268.825734:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6975 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.825740:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6975 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.825750:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94160678ab00) 00010000:00010000:2.0:1790736268.825753:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790736268.825756:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6975 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.825763:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6975 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.825781:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe697c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.825786:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe697c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.825792:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe697c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.825798:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941611931000 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736268.825805:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe697c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.825812:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe697c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.825818:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff941603253d00) 00010000:00010000:2.0:1790736268.825820:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790736268.825823:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe697c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.825829:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe697c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736268.827491:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+47:10503:x1877722797229696:12345-192.168.203.5@tcp:34:lfs.0 Request processed in 1743us (2084us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736268.827509:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 101 00000100:00100000:1.0:1790736268.868207:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736268.868326:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797229952 00000100:00100000:3.0:1790736268.868463:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797229952 00000100:00100000:3.0:1790736268.868563:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 102 00000100:00100000:3.0:1790736268.868576:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+47:10506:x1877722797229952:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1790736268.868814:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736268.868845:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6983 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526ef9 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.868978:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe698a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.868997:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe698a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.869011:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe698a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.869032:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6991 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.869039:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6991 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.869047:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6991 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.869934:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6998 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.869950:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6998 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.869958:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6998 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790736268.869973:0:8114:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1790736268.870273:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe698a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.870283:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe698a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.870305:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe698a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.870312:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c8400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736268.870318:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe698a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.870326:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe698a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.870352:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94161505d100) 00010000:00010000:3.0:1790736268.870356:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736268.870362:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe698a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.870369:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe698a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.870387:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6991 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.870394:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6991 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.870400:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6991 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.870405:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c8000 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736268.870408:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6991 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.870424:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6991 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.870434:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94161505dc00) 00010000:00010000:3.0:1790736268.870436:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736268.870439:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6991 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.870446:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6991 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.870505:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6983 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526ef9 expref: 50 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.870521:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6998 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526ef9 expref: 49 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.870868:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff941603253d00) 00010000:00010000:3.0:1790736268.870870:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790736268.870873:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c8a00, rc 0) 00000100:00100000:3.0:1790736268.871024:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+49:10506:x1877722797229952:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 2449us (2834us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1790736268.871035:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 102 00000100:00100000:1.0:1790736268.875024:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736268.875171:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797230080 00000100:00100000:2.0:1790736268.875191:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797230080 00000100:00100000:2.0:1790736268.875282:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 103 00000100:00100000:2.0:1790736268.875295:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+49:10506:x1877722797230080:12345-192.168.203.5@tcp:54:lfs.0 00010000:00010000:2.0:1790736268.875933:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe69a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.875959:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe69a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.875973:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe69a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.876007:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe69a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.876033:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe69a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.876040:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe69a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.876048:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941611931000 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736268.876054:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe69a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.876062:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe69a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.876077:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff941603253d00) 00010000:00010000:2.0:1790736268.876080:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790736268.876086:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe69a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.876174:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe69a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736268.876324:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+49:10506:x1877722797230080:12345-192.168.203.5@tcp:54:lfs.0 Request processed in 1028us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736268.876333:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 103 00000100:00100000:1.0:1790736268.879340:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736268.879761:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797230336 00000100:00100000:3.0:1790736268.879775:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797230336 00000100:00100000:3.0:1790736268.879888:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 28 00000100:00100000:3.0:1790736268.879901:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+49:10506:x1877722797230336:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:3.0:1790736268.880338:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+50:10506:x1877722797230336:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 437us (1009us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1790736268.880347:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 28 00000100:00100000:1.0:1790736268.964239:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736268.964775:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797230592 00000100:00100000:2.0:1790736268.964789:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797230592 00000100:00100000:2.0:1790736268.964929:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 104 00000100:00100000:2.0:1790736268.964943:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+50:10516:x1877722797230592:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:2.0:1790736268.964985:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736268.965014:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790736268.965061:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe6928 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526edd expref: 50 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.965090:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94161505d100) 00010000:00010000:2.0:1790736268.965158:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790736268.965177:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe69ad lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526f00 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.965329:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe69b4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.965358:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6998 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526ef9 expref: 50 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.965366:0:5843:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe69b4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.965484:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6998 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0x92962417a526ef9 expref: 50 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.965505:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6998 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526ef9 expref: 50 pid: 8114 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736268.965532:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f7f4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1877722816121856:192.168.203.5@tcp:104: 00000100:00100000:2.0:1790736268.965807:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162f7d7600 going to sleep for 11 seconds 00000100:00100000:2.0:1790736268.973739:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f7f4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1877722816121856:192.168.203.5@tcp:104: 00010000:00010000:2.0:1790736268.973796:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe69b4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736268.973969:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736268.974642:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797230720 00000100:00100000:3.0:1790736268.974656:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797230720 00010000:00010000:3.0:1790736268.974723:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6998 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526ef9 expref: 51 pid: 8114 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736268.974787:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 52 00000100:00100000:3.0:1790736268.974800:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+51:2355:x1877722797230720:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790736268.974824:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790736268.974832:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6998 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526ef9 expref: 51 pid: 8114 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.974848:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6998 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526ef9 expref: 51 pid: 8114 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.974884:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6998 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526ef9 expref: 51 pid: 8114 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.974906:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff941603253d00) 00010000:00010000:3.0:1790736268.974912:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe69b4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.974927:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe69b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.974938:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe69b4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.974985:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790736268.975262:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe69b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.975273:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe69b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790736268.975304:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1790736268.975724:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe69ad lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f00 expref: 52 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.975749:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe69b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f00 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.975759:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff941603253d00) 00010000:00010000:2.0:1790736268.975762:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790736268.975764:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611930400, rc 0) 00000100:00100000:3.0:1790736268.975913:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+51:2355:x1877722797230720:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 1113us (1944us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736268.975925:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 52 00000100:00100000:2.0:1790736268.976226:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+50:10516:x1877722797230592:12345-192.168.203.5@tcp:101:bash.0 Request processed in 11286us (12003us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1790736268.976235:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 104 00000100:00100000:1.0:1790736268.979959:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736268.980049:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797230976 00000100:00100000:3.0:1790736268.980063:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797230976 00000100:00100000:3.0:1790736268.980181:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 105 00000100:00100000:3.0:1790736268.980192:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+50:10516:x1877722797230976:12345-192.168.203.5@tcp:36:bash.0 00010000:00010000:3.0:1790736268.980922:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe69c2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.980958:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe69c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.980979:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe69c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790736268.981048:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1790736268.981077:0:5844:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b8323179 reply state 000000000cda91e1 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe69c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736268.981087:0:5844:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790736268.981332:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+53:10516:x1877722797230976:12345-192.168.203.5@tcp:36:bash.0 Request processed in 1137us (1383us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1790736268.981341:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 105 00000020:00080000:3.0:1790736268.981348:0:5844:0:(tgt_main.c:787:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790736268.986955:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00010000:00010000:3.0:1790736268.987068:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe69c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.987137:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe69c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.987146:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe69c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.987153:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c8a00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736268.987159:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe69c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.987168:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe69c2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.987188:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff941603253d00) 00010000:00010000:3.0:1790736268.987191:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736268.987198:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe69c2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.987205:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe69c2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736268.987310:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797231104 00000100:00100000:2.0:1790736268.987325:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797231104 00000100:00100000:2.0:1790736268.987410:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 106 00000100:00100000:2.0:1790736268.987431:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+52:10516:x1877722797231104:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:2.0:1790736268.987465:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736268.987511:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe69c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526f07 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.987685:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe69d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.987702:0:8114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe69b4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f00 expref: 53 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.987718:0:8114:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe69d0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.987763:0:8114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe69b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f00 expref: 53 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.987777:0:8114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe69b4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f00 expref: 53 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736268.987794:0:8114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f7f4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8114:1877722816121984:192.168.203.5@tcp:104: 00000100:00100000:2.0:1790736268.987924:0:8114:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162f7d7780 going to sleep for 11 seconds 00000100:00100000:2.0:1790736268.993326:0:8114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f7f4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8114:1877722816121984:192.168.203.5@tcp:104: 00010000:00010000:2.0:1790736268.993372:0:8114:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe69d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736268.995400:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736268.995652:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797231232 00000100:00100000:2.0:1790736268.995670:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797231232 00010000:00010000:2.0:1790736268.995732:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe69b4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f00 expref: 54 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736268.995791:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 53 00000100:00100000:2.0:1790736268.995833:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cf8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+54:2356:x1877722797231232:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790736268.995854:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790736268.995862:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe69b4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f00 expref: 54 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.995886:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe69b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f00 expref: 54 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.995925:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe69b4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f00 expref: 54 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.995947:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff941603253d00) 00010000:00010000:2.0:1790736268.995953:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe69d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.995966:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe69d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.995976:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe69d0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736268.996017:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790736268.996191:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cf8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+53:2356:x1877722797231232:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 367us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736268.996201:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 53 00010000:00010000:3.0:1790736268.996303:0:8114:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe69d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.996313:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe69d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790736268.996371:0:8114:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1790736268.996376:0:8114:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790736268.996408:0:8114:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe69d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.996467:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe69c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f07 expref: 53 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.996484:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe69d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f07 expref: 52 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736268.996491:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff941603253d00) 00010000:00010000:3.0:1790736268.996494:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790736268.996497:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611931600, rc 0) 00000100:00100000:3.0:1790736268.996547:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+52:10516:x1877722797231104:12345-192.168.203.5@tcp:101:bash.0 Request processed in 9126us (9615us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736268.996555:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 106 00000100:00100000:0.0:1790736269.001352:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736269.001744:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797231488 00000100:00100000:3.0:1790736269.001760:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797231488 00000100:00100000:3.0:1790736269.001839:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 29 00000100:00100000:3.0:1790736269.001851:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+52:10516:x1877722797231488:12345-192.168.203.5@tcp:35:bash.0 00000100:00100000:0.0:1790736269.002966:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+53:10516:x1877722797231488:12345-192.168.203.5@tcp:35:bash.0 Request processed in 1109us (1637us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1790736269.002979:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 29 00000100:00100000:0.0:1790736269.071041:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736269.071164:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797231616 00000100:00100000:3.0:1790736269.071179:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797231616 00000100:00100000:3.0:1790736269.071255:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 107 00000100:00100000:3.0:1790736269.071268:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+53:10522:x1877722797231616:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1790736269.071307:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736269.071334:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe69d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526f0e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.071537:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe69de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.071580:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe69de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.071594:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe69de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790736269.071642:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1790736269.071648:0:5844:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790736269.071672:0:5844:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe69de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.071704:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe69d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f0e expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.071726:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe69de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f0e expref: 54 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.072039:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94161505d100) 00010000:00010000:3.0:1790736269.072042:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790736269.072048:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c8e00, rc 0) 00000100:00100000:3.0:1790736269.073064:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+54:10522:x1877722797231616:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1788us (2033us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736269.073077:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 107 00010000:00010000:1.0:1790736269.078160:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736269.080317:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736269.080669:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797231744 00000100:00100000:3.0:1790736269.080686:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797231744 00000100:00100000:3.0:1790736269.080896:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 108 00000100:00100000:3.0:1790736269.080910:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+54:10522:x1877722797231744:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1790736269.080944:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736269.080991:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe69e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526f15 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.081688:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe69ec lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.081715:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe69ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.081967:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe69ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.082134:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe69f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.082147:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe69f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.082156:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe69f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.082307:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe69fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.082319:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe69fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.082327:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe69fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790736269.082375:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1790736269.082380:0:5843:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790736269.082597:0:5843:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe69fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.082615:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe69fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.082627:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe69ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.082637:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe69ec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.082645:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe69ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.082652:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c8000 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736269.082658:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe69ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.082668:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe69ec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.082694:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94161505d100) 00010000:00010000:0.0:1790736269.082697:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736269.082703:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe69ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.082710:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe69ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.082837:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe69f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.082846:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe69f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.082853:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe69f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.082859:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642173e00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736269.082862:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe69f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.082870:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe69f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.082879:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff941605242500) 00010000:00010000:0.0:1790736269.082881:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736269.082884:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe69f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.082891:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe69f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.082966:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe69e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f15 expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.082985:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe69fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f15 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.082995:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff941603253d00) 00010000:00010000:0.0:1790736269.082997:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790736269.083000:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941642173600, rc 0) 00000100:00100000:0.0:1790736269.083263:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+55:10522:x1877722797231744:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 2354us (2961us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736269.083275:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 108 00000100:00100000:0.0:1790736269.086553:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736269.086668:0:8527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797231872 00000100:00100000:2.0:1790736269.086684:0:8527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797231872 00000100:00100000:2.0:1790736269.086847:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 7 00000100:00100000:2.0:1790736269.086860:0:8527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+55:2355:x1877722797231872:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790736269.086922:0:8527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790736269.086965:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe69fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f15 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.086998:0:8527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff941603253d00) 00010000:00010000:2.0:1790736269.087004:0:8527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790736269.087083:0:8527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+54:2355:x1877722797231872:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 226us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736269.087136:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 7 00000100:00100000:1.0:1790736269.094849:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736269.094995:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797232128 00000100:00100000:2.0:1790736269.095010:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797232128 00000100:00100000:2.0:1790736269.095090:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 109 00000100:00100000:2.0:1790736269.095241:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+54:10522:x1877722797232128:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1790736269.095276:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736269.095305:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6a01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526f1c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.095475:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe6a08 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.095494:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe69d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f07 expref: 55 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.095504:0:5845:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe6a08 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.095556:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe69d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f07 expref: 55 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.095610:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe69d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f07 expref: 55 pid: 8114 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736269.095628:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f7f4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1877722816122112:192.168.203.5@tcp:104: 00000100:00100000:2.0:1790736269.095781:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162f7d7780 going to sleep for 11 seconds 00000100:00100000:1.0:1790736269.101852:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736269.101928:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797232256 00000100:00100000:0.0:1790736269.101942:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797232256 00010000:00010000:0.0:1790736269.102006:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe69d0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f07 expref: 56 pid: 8114 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736269.102056:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 54 00000100:00100000:2.0:1790736269.102063:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f7f4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1877722816122112:192.168.203.5@tcp:104: 00000100:00100000:0.0:1790736269.102067:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160557d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+56:2356:x1877722797232256:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790736269.102085:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790736269.102116:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe69d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f07 expref: 56 pid: 8114 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.102127:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe6a08 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.102132:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe69d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f07 expref: 56 pid: 8114 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.103461:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe69d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f07 expref: 56 pid: 8114 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.103489:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff941603253d00) 00010000:00010000:0.0:1790736269.103495:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe6a08 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.103507:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe6a08 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.103516:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe6a08 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.103844:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790736269.104007:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe6a08 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.104018:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe6a08 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790736269.104045:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1790736269.104289:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6a01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f1c expref: 57 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.104324:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe6a08 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f1c expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.104334:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff941603253d00) 00010000:00010000:2.0:1790736269.104337:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790736269.104340:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611931000, rc 0) 00000100:00100000:0.0:1790736269.104459:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160557d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+56:2356:x1877722797232256:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 2392us (2622us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736269.104472:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 54 00000100:00100000:2.0:1790736269.105548:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+55:10522:x1877722797232128:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 10287us (10801us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1790736269.105587:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 109 00000100:00100000:0.0:1790736269.110220:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736269.110328:0:8527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797232512 00000100:00100000:2.0:1790736269.110342:0:8527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797232512 00000100:00100000:2.0:1790736269.110604:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 8 00000100:00100000:2.0:1790736269.110619:0:8527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+55:10522:x1877722797232512:12345-192.168.203.5@tcp:103:lfs.0 00010000:00010000:2.0:1790736269.110647:0:8527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790736269.110683:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6967 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526ef2 expref: 55 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.110706:0:8527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff941603253d00) 00010000:00010000:2.0:1790736269.110713:0:8527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790736269.110897:0:8527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+54:10522:x1877722797232512:12345-192.168.203.5@tcp:103:lfs.0 Request processed in 280us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736269.110907:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 8 00000100:00100000:1.0:1790736269.114245:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736269.114500:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797232640 00000100:00100000:2.0:1790736269.114514:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797232640 00000100:00100000:2.0:1790736269.114974:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 110 00000100:00100000:2.0:1790736269.114987:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+54:10522:x1877722797232640:12345-192.168.203.5@tcp:58:lfs.0 00010000:00010000:2.0:1790736269.115159:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6a16 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.115184:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6a16 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.115198:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6a16 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790736269.115507:0:8114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1790736269.116007:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+54:10522:x1877722797232640:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 1016us (1773us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736269.116018:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 110 00000100:00100000:0.0:1790736269.119774:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736269.119899:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797232768 00000100:00100000:3.0:1790736269.119914:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797232768 00000100:00100000:3.0:1790736269.120033:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 111 00000100:00100000:3.0:1790736269.120046:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+54:10522:x1877722797232768:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1790736269.120074:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736269.120136:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe6a1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526f23 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.120222:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6a16 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.120235:0:5844:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe6a1d lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f23 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.120260:0:5844:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6a16 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.120276:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe6a1d lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f23 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.120319:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff941603253d00) 00010000:00010000:3.0:1790736269.120323:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790736269.120328:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe6a1d lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f23 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.120336:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c8400, rc 0) 00000100:00100000:3.0:1790736269.120431:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+55:10522:x1877722797232768:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 387us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736269.120438:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 111 00000100:00100000:0.0:1790736269.334602:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736269.334663:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736269.334708:0:8632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797233024 00000100:00100000:0.0:1790736269.334717:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736269.334737:0:8632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797233024 00000100:00100000:0.0:1790736269.334753:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736269.334790:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797233280 00000100:00100000:0.0:1790736269.334796:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797233280 00000100:00100000:2.0:1790736269.334832:0:8632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797233152 00000100:00100000:2.0:1790736269.334838:0:8632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797233152 00000100:00100000:0.0:1790736269.334885:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 136 00000100:00100000:0.0:1790736269.334902:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2356:x1877722797233280:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1790736269.334978:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797232896 00000100:00100000:1.0:1790736269.334985:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797232896 00000100:00100000:1.0:1790736269.335031:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 288 00000100:00100000:1.0:1790736269.335042:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+13:2355:x1877722797232896:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1790736269.335066:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2356:x1877722797233280:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 168us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736269.335078:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 136 00000100:00100000:1.0:1790736269.335086:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+13:2355:x1877722797232896:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 45us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736269.335116:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 288 00000100:00080000:0.0:1790736269.335143:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790736269.338112:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 75 00000100:00100000:2.0:1790736269.338149:0:8632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+8:2356:x1877722797233024:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1790736269.338286:0:8632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+8:2356:x1877722797233024:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 156us (3703us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736269.338296:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 75 00000100:00100000:2.0:1790736269.338324:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 76 00000100:00100000:2.0:1790736269.338333:0:8632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+9:2355:x1877722797233152:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1790736269.338363:0:8632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+9:2355:x1877722797233152:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 32us (3646us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736269.338369:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 76 00000100:00100000:2.0:1790736269.461494:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f7f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877722816122368:0@lo:400:kworker.0 00000100:00100000:0.0:1790736269.461608:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f7f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52e04a2b-4e01-44b7-985c-7db034e22389:3307:1877722816122240:0@lo:400:kworker.0 00000100:00100000:1.0:1790736269.461685:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f7f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816122624:0@lo:400:kworker.0 00000100:00100000:0.0:1790736269.462672:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736269.462818:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1877722816122752:0@lo:400:kworker.0 00000100:00100000:0.0:1790736269.462876:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736269.462974:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f7f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1877722816122496:0@lo:400:kworker.0 00000100:00100000:0.0:1790736269.463010:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736269.463062:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816122240 00000100:00100000:0.0:1790736269.463074:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816122240 00000100:00100000:0.0:1790736269.463159:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1790736269.463171:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606654050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+19:3307:x1877722816122240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736269.463259:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606654050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+19:3307:x1877722816122240:12345-0@lo:400:kworker.0 Request processed in 90us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736269.463268:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1790736269.463339:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f7f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52e04a2b-4e01-44b7-985c-7db034e22389:3307:1877722816122240:0@lo:400:kworker.0 00000100:00100000:3.0:1790736269.465811:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816122752 00000100:00100000:3.0:1790736269.465835:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816122752 00000100:00100000:3.0:1790736269.465945:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816122496 00000100:00100000:3.0:1790736269.465950:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816122496 00000100:00100000:3.0:1790736269.465997:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1790736269.466011:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877722816122752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736269.466202:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877722816122752:12345-0@lo:400:kworker.0 Request processed in 194us (3325us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736269.466212:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1790736269.466239:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1790736269.466245:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877722816122496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736269.466286:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877722816122496:12345-0@lo:400:kworker.0 Request processed in 41us (3275us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736269.466293:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1790736269.466351:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f7f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1877722816122496:0@lo:400:kworker.0 00000100:00100000:3.0:1790736269.466393:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1877722816122752:0@lo:400:kworker.0 00000100:00080000:0.0:1790736269.468448:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790736269.469336:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736269.471235:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736269.471290:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160838f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816122880:0@lo:400:kworker.0 00000100:00100000:2.0:1790736269.471338:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736269.471412:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816122368 00000100:00100000:1.0:1790736269.471425:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816122368 00000100:00100000:1.0:1790736269.471526:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1790736269.471548:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160838f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877722816122368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736269.471629:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160838f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877722816122368:12345-0@lo:400:kworker.0 Request processed in 93us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736269.471638:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1790736269.485060:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f7f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877722816122368:0@lo:400:kworker.0 00000100:00100000:0.0:1790736269.492814:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816122624 00000100:00100000:0.0:1790736269.492839:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816122624 00000100:00100000:0.0:1790736269.492954:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816122880 00000100:00100000:0.0:1790736269.492958:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816122880 00000100:00100000:0.0:1790736269.492992:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790736269.493002:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1877722816122624:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1790736269.493938:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790736269.494011:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790736269.494027:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3308:x1877722816122880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736269.494206:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3308:x1877722816122880:12345-0@lo:400:kworker.0 Request processed in 185us (22867us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736269.494215:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790736269.494291:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160838f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816122880:0@lo:400:kworker.0 00000100:00100000:0.0:1790736269.494969:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1877722816122624:12345-0@lo:400:kworker.0 Request processed in 1959us (25631us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736269.494983:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790736269.495140:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f7f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816122624:0@lo:400:kworker.0 00000040:00080000:0.0:1790736269.528270:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790736269.528288:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790736269.528350:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1790736269.528358:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790736269.528569:0:11704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163c5e7b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11704:1877722816123008:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790736269.528749:0:11704:0:(client.c:2716:ptlrpc_set_wait()) set ffff941637e9b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790736269.553373:0:11704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163c5e7b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11704:1877722816123008:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790736269.553612:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736269.553970:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797233408 00000100:00100000:0.0:1790736269.553980:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797233408 00000100:00100000:0.0:1790736269.554051:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 112 00000100:00100000:0.0:1790736269.554063:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+55:10523:x1877722797233408:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790736269.559125:0:5843:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790736269.559352:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+55:10523:x1877722797233408:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 5282us (5735us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736269.559369:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 112 00000100:00100000:2.0:1790736269.564620:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736269.564727:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797233536 00000100:00100000:1.0:1790736269.564741:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797233536 00000100:00100000:1.0:1790736269.564825:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 113 00000100:00100000:1.0:1790736269.564838:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+55:10523:x1877722797233536:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1790736269.564937:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6a24 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.564961:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6a24 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.564973:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6a24 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.567580:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6a2b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.567610:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6a2b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.567625:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6a2b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.567664:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6a32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.567674:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6a32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.567680:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6a32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790736269.567728:0:8114:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1790736269.567940:0:8114:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790736269.567958:0:8114:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6a32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.567971:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6a24 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.567979:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6a24 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.567986:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6a24 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.567992:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60800 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736269.567997:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6a24 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.568005:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6a24 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.568016:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94160678a900) 00010000:00010000:1.0:1790736269.568019:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736269.568024:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6a24 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.568030:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6a24 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.568046:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6a2b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.568052:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6a2b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.568068:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6a2b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.568074:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60a00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736269.568077:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6a2b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.568083:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6a2b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.568091:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff941603253500) 00010000:00010000:1.0:1790736269.568141:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736269.568144:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6a2b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.568150:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6a2b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.568171:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6a32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.568178:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6a32 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.568184:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6a32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.568190:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736269.568194:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6a32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.568210:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6a32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.568221:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff941603253d00) 00010000:00010000:1.0:1790736269.568224:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736269.568229:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6a32 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.568236:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6a32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736269.568338:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+55:10523:x1877722797233536:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 Request processed in 3498us (3728us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736269.568353:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 113 00000100:00100000:0.0:1790736269.571622:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736269.571726:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797233792 00000100:00100000:3.0:1790736269.571739:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797233792 00000100:00100000:2.0:1790736269.571946:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 114 00000100:00100000:2.0:1790736269.571962:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c5e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+55:10523:x1877722797233792:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790736269.571995:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736269.572026:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931800/0x6aae200528fe6a39 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526f2a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.572296:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe6a40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.572318:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe6a40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.572335:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe6a40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790736269.572349:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1790736269.572993:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe6a40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.573023:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe6a40 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.573030:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe6a40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.573037:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941611930c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736269.573042:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe6a40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.573051:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe6a40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.573065:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff941603253d00) 00010000:00010000:2.0:1790736269.573069:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790736269.573074:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe6a40 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.573081:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe6a40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.573162:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931800/0x6aae200528fe6a39 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f2a expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.573174:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94160678a900) 00010000:00010000:2.0:1790736269.573176:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790736269.573181:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931800/0x6aae200528fe6a39 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f2a expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.573191:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611931800, rc 0) 00000100:00100000:2.0:1790736269.573291:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c5e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+56:10523:x1877722797233792:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 1334us (1683us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1790736269.573300:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 114 00000100:00100000:3.0:1790736269.594621:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736269.594778:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797233920 00000100:00100000:1.0:1790736269.594793:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797233920 00000100:00100000:1.0:1790736269.594875:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 115 00000100:00100000:1.0:1790736269.594889:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+56:10523:x1877722797233920:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790736269.594947:0:5844:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790736269.595142:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+56:10523:x1877722797233920:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 256us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736269.595151:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 115 00000100:00100000:0.0:1790736269.609618:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736269.612744:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797234176 00000100:00100000:3.0:1790736269.613057:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797234176 00000100:00100000:3.0:1790736269.613179:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 116 00000100:00100000:3.0:1790736269.613191:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c5e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+56:10523:x1877722797234176:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790736269.613213:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736269.613216:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790736269.613247:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe69de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f0e expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.613269:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94161505d100) 00010000:00010000:3.0:1790736269.613274:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790736269.617711:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe6a4e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526f31 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790736269.618412:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1790736269.618618:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6a55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.618633:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6a55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.618645:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6a55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.618723:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe6a4e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f31 expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.618742:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6a55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f31 expref: 57 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.618770:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94161505dc00) 00010000:00010000:3.0:1790736269.618773:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790736269.618776:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c8a00, rc 0) 00000100:00100000:3.0:1790736269.618854:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c5e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+57:10523:x1877722797234176:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 5665us (9253us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1790736269.618864:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 116 00000100:00100000:2.0:1790736269.623589:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736269.627150:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797234432 00000100:00100000:1.0:1790736269.627169:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797234432 00000100:00100000:1.0:1790736269.627248:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 117 00000100:00100000:1.0:1790736269.627259:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+57:10523:x1877722797234432:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790736269.627331:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736269.627378:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6a55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f31 expref: 57 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.627401:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94161505dc00) 00010000:00010000:1.0:1790736269.627416:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790736269.627439:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6a63 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.627453:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6a63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.627464:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6a63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.627478:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6a6a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x96ca68d8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.627485:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6a6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x96ca68d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.627491:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6a6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x96ca68d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.627570:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6a63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.627579:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6a63 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.627587:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6a63 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.627593:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60a00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736269.627604:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6a63 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.627612:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6a63 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.627622:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94161505d100) 00010000:00010000:1.0:1790736269.627624:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736269.627629:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6a63 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.627636:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6a63 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.627658:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6a6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x96ca68d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.627665:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6a6a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x96ca68d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.627672:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6a6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x96ca68d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.627677:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60800 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736269.627680:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6a6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x96ca68d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.627687:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6a6a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x96ca68d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.627694:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x96ca68d8 (ffff941603253500) 00010000:00010000:1.0:1790736269.627696:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736269.627704:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6a6a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x96ca68d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.627710:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6a6a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x96ca68d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736269.627945:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+56:10523:x1877722797234432:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 687us (4371us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790736269.627955:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 117 00000100:00100000:1.0:1790736269.630137:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736269.630299:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797234560 00000100:00100000:2.0:1790736269.630310:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797234560 00000100:00100000:2.0:1790736269.630363:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 118 00000100:00100000:2.0:1790736269.630374:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+56:10523:x1877722797234560:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790736269.630392:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736269.630415:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe6a71 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526f38 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.630449:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe6a78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.630462:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe6a78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.630474:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe6a78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.630593:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe6a71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f38 expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.630612:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe6a78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f38 expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.630621:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94160678ab00) 00010000:00010000:2.0:1790736269.630624:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790736269.630644:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611931600, rc 0) 00000100:00100000:2.0:1790736269.630706:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+57:10523:x1877722797234560:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 333us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736269.630713:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 118 00000100:00100000:2.0:1790736269.633551:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736269.633627:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797234816 00000100:00100000:1.0:1790736269.633646:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797234816 00000100:00100000:1.0:1790736269.633696:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 119 00000100:00100000:1.0:1790736269.633705:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160838f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+57:10523:x1877722797234816:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790736269.633918:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6a7f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.633936:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6a7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.633949:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6a7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790736269.634254:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:1.0:1790736269.634264:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 341645169750ns, next at 342645167368ns, rc = 0 00000004:00010000:1.0:1790736269.634510:0:5844:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c934e322 reply state 000000003d924c0e transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6a7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736269.634533:0:5844:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790736269.636025:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160838f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+59:10523:x1877722797234816:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 932us (1093us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1790736269.636056:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 119 00010000:00010000:3.0:1790736269.639945:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6a7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.639969:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6a7f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.639978:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6a7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.639986:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60e00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736269.639993:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6a7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.640011:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6a7f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.640033:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94160678ab00) 00010000:00010000:3.0:1790736269.640068:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790736269.640077:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6a7f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.640083:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6a7f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736269.645873:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736269.645969:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797234944 00000100:00100000:3.0:1790736269.645990:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797234944 00000100:00100000:2.0:1790736269.646442:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 120 00000100:00100000:2.0:1790736269.646456:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+58:10523:x1877722797234944:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790736269.646506:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736269.646542:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe6a86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526f3f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.646761:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe6a86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f3f expref: 59 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.646779:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe6a86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f3f expref: 59 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.646806:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94160678ab00) 00010000:00010000:2.0:1790736269.646809:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790736269.646814:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611930c00, rc 0) 00000100:00100000:2.0:1790736269.646906:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+59:10523:x1877722797234944:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 452us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736269.646914:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 120 00000100:00100000:1.0:1790736269.662779:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736269.663829:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797235072 00000100:00100000:2.0:1790736269.663849:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797235072 00000100:00100000:2.0:1790736269.664066:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 37 00000100:00100000:2.0:1790736269.664080:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+8:2355:x1877722797235072:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1790736269.664580:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+9:2355:x1877722797235072:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 Request processed in 502us (1821us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1790736269.664590:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 37 00000100:00100000:1.0:1790736269.678216:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736269.678932:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797235328 00000100:00100000:3.0:1790736269.678954:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797235328 00000100:00100000:3.0:1790736269.679056:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 30 00000100:00100000:3.0:1790736269.679070:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+59:10523:x1877722797235328:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790736269.679693:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+60:10523:x1877722797235328:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 621us (1483us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1790736269.679706:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 30 00000100:00100000:0.0:1790736269.683650:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736269.684160:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797235584 00000100:00100000:3.0:1790736269.684177:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797235584 00000100:00100000:3.0:1790736269.684276:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 121 00000100:00100000:3.0:1790736269.684291:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c5e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+60:10523:x1877722797235584:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790736269.684620:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c5e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+60:10523:x1877722797235584:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 328us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736269.684632:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 121 00000100:00100000:1.0:1790736269.688431:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736269.688782:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797235712 00000100:00100000:2.0:1790736269.688796:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797235712 00000100:00100000:2.0:1790736269.688877:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 122 00000100:00100000:2.0:1790736269.688891:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633818e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+60:10523:x1877722797235712:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790736269.689004:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736269.689040:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe6a8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526f46 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.689214:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931800/0x6aae200528fe6a94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.689235:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611931800/0x6aae200528fe6a94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.689252:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931800/0x6aae200528fe6a94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790736269.689308:0:5843:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790736269.689340:0:5843:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff941611931800/0x6aae200528fe6a94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.689373:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931a00/0x6aae200528fe6a8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f46 expref: 62 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.689398:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931800/0x6aae200528fe6a94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f46 expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.690031:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94160678ab00) 00010000:00010000:2.0:1790736269.690036:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790736269.690042:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611931800, rc 0) 00000100:00100000:2.0:1790736269.690260:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633818e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+61:10523:x1877722797235712:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 1368us (1852us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736269.690269:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 122 00000100:00100000:3.0:1790736269.698921:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736269.699724:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797235840 00000100:00100000:1.0:1790736269.699742:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797235840 00000100:00100000:1.0:1790736269.699824:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 38 00000100:00100000:1.0:1790736269.699835:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+9:2353:x1877722797235840:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790736269.699867:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736269.700524:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9a369b1/0x6aae200528fe6a9b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526f4d expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790736269.700826:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abc778e, blocks: 0x1 00010000:00010000:1.0:1790736269.700858:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=341s v=(0 0) 00010000:00010000:1.0:1790736269.700864:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790736269.700882:0:6697:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9a369b1/0x6aae200528fe6a9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f4d expref: 10 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.702805:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c9a369b1/0x6aae200528fe6a9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f4d expref: 10 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.702846:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c60c00, rc 0) 00000100:00100000:1.0:1790736269.702990:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+10:2353:x1877722797235840:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 3154us (4089us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736269.703003:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 38 00000100:00100000:1.0:1790736269.710745:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736269.711030:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797236096 00000100:00100000:3.0:1790736269.711047:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797236096 00000100:00100000:3.0:1790736269.711188:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 123 00000100:00100000:3.0:1790736269.711201:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+61:10523:x1877722797236096:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790736269.711421:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+61:10523:x1877722797236096:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 222us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736269.711431:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 123 00000100:00100000:2.0:1790736269.721370:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736269.725605:0:8632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797236224 00000100:00100000:3.0:1790736269.725628:0:8632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797236224 00000100:00100000:3.0:1790736269.725722:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 39 00000100:00100000:3.0:1790736269.725736:0:8632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+10:10523:x1877722797236224:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790736269.725762:0:8632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736269.725789:0:8632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe88ea5f/0x6aae200528fe6aa2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526f54 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.725848:0:8632:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c9a369b1/0x6aae200528fe6a9b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f4d expref: 11 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.726049:0:8632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790736269.726055:0:8632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790736269.726063:0:8632:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe88ea5f/0x6aae200528fe6aa2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f54 expref: 11 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.726147:0:8632:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c9a369b1/0x6aae200528fe6a9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f4d expref: 11 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.726351:0:8632:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c9a369b1/0x6aae200528fe6a9b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f4d expref: 11 pid: 6697 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736269.726370:0:8632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163ae3a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8632:1877722816123136:192.168.203.5@tcp:104: 00000100:00100000:3.0:1790736269.726547:0:8632:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162a685780 going to sleep for 11 seconds 00000100:00100000:0.0:1790736269.729837:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736269.730034:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797236352 00000100:00100000:1.0:1790736269.730049:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797236352 00000100:00100000:3.0:1790736269.730079:0:8632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163ae3a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8632:1877722816123136:192.168.203.5@tcp:104: 00010000:00010000:3.0:1790736269.730163:0:8632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fe88ea5f/0x6aae200528fe6aa2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0x92962417a526f54 expref: 12 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.730193:0:8632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c9400, rc 0) 00000100:00100000:3.0:1790736269.730279:0:8632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+12:10523:x1877722797236224:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 4545us (8923us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736269.730291:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 39 00010000:00010000:1.0:1790736269.730524:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c9a369b1/0x6aae200528fe6a9b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f4d expref: 11 pid: 6697 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736269.730564:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 55 00000100:00100000:1.0:1790736269.730575:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c5e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+11:2355:x1877722797236352:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790736269.730593:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736269.730625:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c9a369b1/0x6aae200528fe6a9b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f4d expref: 11 pid: 6697 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.730640:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c9a369b1/0x6aae200528fe6a9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f4d expref: 11 pid: 6697 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.730674:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9a369b1/0x6aae200528fe6a9b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f4d expref: 11 pid: 6697 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.730692:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790736269.730698:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790736269.730709:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe88ea5f/0x6aae200528fe6aa2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0x92962417a526f54 expref: 10 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.730721:0:5830:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe88ea5f/0x6aae200528fe6aa2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0x92962417a526f54 expref: 10 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.730768:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fe88ea5f/0x6aae200528fe6aa2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0x92962417a526f54 expref: 10 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736269.730807:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163381b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5830:1877722816123264:192.168.203.5@tcp:105: 00000100:00100000:1.0:1790736269.732308:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607c03cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790736269.739586:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736269.739614:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163381b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5830:1877722816123264:192.168.203.5@tcp:105: 00010000:00010000:1.0:1790736269.739650:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790736269.739739:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c5e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+10:2355:x1877722797236352:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 9164us (9917us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736269.739753:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 55 00000100:00100000:3.0:1790736269.740863:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797236480 00000100:00100000:3.0:1790736269.740882:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797236480 00002000:00100000:2.0:1790736269.741360:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff94163c5e7b80 x1877722797236480/t0(0) o4->f945944d-9086-46a2-a91c-8bc7b88e8918@192.168.203.5@tcp:100/0 lens 504/0 e 0 to 0 dl 1790736280 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790736269.741376:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94163c5e7b80 with x1877722797236480 ext(0->12) 00002000:00010000:2.0:1790736269.741385:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94163c5e7b80 00000100:00100000:2.0:1790736269.741427:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2 00000100:00100000:2.0:1790736269.741439:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c5e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+10:2355:x1877722797236480:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1790736269.742714:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c5e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+12:2355:x1877722797236480:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 1263us (3129us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1790736269.742730:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2 00002000:00100000:2.0:1790736269.742743:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff94163c5e7b80 x1877722797236480/t4294967308(0) o4->f945944d-9086-46a2-a91c-8bc7b88e8918@192.168.203.5@tcp:100/0 lens 504/448 e 0 to 0 dl 1790736280 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790736269.742755:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94163c5e7b80 with x1877722797236480 ext(0->12) 00002000:00010000:2.0:1790736269.742762:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94163c5e7b80 00000100:00100000:0.0:1790736269.751806:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736269.751974:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797236608 00000100:00100000:3.0:1790736269.751989:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797236608 00000100:00100000:2.0:1790736269.752374:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 124 00000100:00100000:2.0:1790736269.752392:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+61:10523:x1877722797236608:12345-192.168.203.5@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1790736269.850485:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967375 is committed 00000004:00080000:1.0:1790736269.850505:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:1.0:1790736269.850970:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f7f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816123392:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1790736269.851077:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736269.851242:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816123392 00000100:00100000:0.0:1790736269.851252:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816123392 00000100:00100000:0.0:1790736269.851309:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790736269.851319:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163381b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1877722816123392:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1790736269.851355:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:0.0:1790736269.851392:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f67c1b0f/0x6aae200528fe6aa9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.851444:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a669fd82/0x6aae200528fe686b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.5@tcp remote: 0x92962417a526eb3 expref: 11 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.851454:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1790736269.851459:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790736269.851471:0:6698:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f67c1b0f/0x6aae200528fe6aa9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.851500:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a669fd82/0x6aae200528fe686b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.5@tcp remote: 0x92962417a526eb3 expref: 11 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.851525:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a669fd82/0x6aae200528fe686b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.5@tcp remote: 0x92962417a526eb3 expref: 11 pid: 8632 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736269.851540:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f7f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6698:1877722816123520:192.168.203.5@tcp:104: 00000100:00100000:0.0:1790736269.851616:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff941637e9b240 going to sleep for 11 seconds 00000001:00080000:1.0:1790736269.852012:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:1.0:1790736269.852021:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000100:00100000:3.0:1790736269.852477:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790736269.852495:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f7f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816123648:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1790736269.852572:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736269.852730:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816123648 00000100:00100000:0.0:1790736269.852741:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816123648 00000100:00100000:0.0:1790736269.852799:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790736269.852810:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3307:x1877722816123648:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1790736269.853058:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1790736269.853063:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1790736270 00002000:00010000:0.0:1790736269.853065:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1790736269.853067:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1790736270 -> 1790736270 00002000:00010000:0.0:1790736269.853069:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1790736269.853168:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3307:x1877722816123648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 359us (596us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1790736269.853177:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:3.0:1790736269.854548:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94162f7f4700/2, rc 0, transno 4294967309 00000100:00100000:3.0:1790736269.854569:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f7f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816123648:0@lo:2:osp-syn-0-0.0 00000020:00080000:1.0:1790736269.856704:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff941605768e40 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1790736269.856722:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94163ad0ff00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9416057689c0 00000020:00080000:1.0:1790736269.856726:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94163ad0fe00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94163ae17c00 00000001:00080000:1.0:1790736269.856756:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1790736269.856791:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1790736269.856816:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff94162a685b40 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1790736269.856820:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9416055d6200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff94162a685900 00000020:00080000:1.0:1790736269.856822:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9416055d6a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94162f520000 00000020:00080000:0.0:1790736269.857701:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1790736269.857948:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1790736269.858061:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790736269.858090:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b30ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816123776:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1790736269.858116:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+15:10523:x1877722797236608:12345-192.168.203.5@tcp:44:lhsmtool_posix.0 Request processed in 105705us (106301us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736269.858130:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 124 00000100:00100000:3.0:1790736269.858198:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736269.858334:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816123776 00000100:00100000:1.0:1790736269.858347:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816123776 00000100:00100000:2.0:1790736269.860529:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736269.861385:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f7f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6698:1877722816123520:192.168.203.5@tcp:104: 00010000:00010000:0.0:1790736269.861426:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f67c1b0f/0x6aae200528fe6aa9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736269.862218:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790736269.862233:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3306:x1877722816123776:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1790736269.862283:0:6697:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:1.0:1790736269.862340:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6abc778c, atime: 0x6abc778d, ctime: 0x6abc778c, blocks: 0x1 00010000:00010000:1.0:1790736269.862350:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9a369b1/0x6aae200528fe6ab0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.862369:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=341s v=(0 0) 00010000:00010000:1.0:1790736269.862386:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790736269.862395:0:6697:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9a369b1/0x6aae200528fe6ab0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.862421:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9a369b1/0x6aae200528fe6ab0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.862434:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9a369b1/0x6aae200528fe6ab0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.862443:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9a369b1/0x6aae200528fe6ab0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.862697:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790736269.863355:0:8527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797236736 00000100:00100000:2.0:1790736269.863368:0:8527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797236736 00010000:00010000:2.0:1790736269.863425:0:8527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a669fd82/0x6aae200528fe686b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.5@tcp remote: 0x92962417a526eb3 expref: 12 pid: 8632 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736269.863470:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 56 00000100:00100000:2.0:1790736269.863480:0:8527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+12:2356:x1877722797236736:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790736269.863495:0:8527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790736269.863502:0:8527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a669fd82/0x6aae200528fe686b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.5@tcp remote: 0x92962417a526eb3 expref: 12 pid: 8632 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.863526:0:8527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a669fd82/0x6aae200528fe686b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.5@tcp remote: 0x92962417a526eb3 expref: 12 pid: 8632 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.863561:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a669fd82/0x6aae200528fe686b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.5@tcp remote: 0x92962417a526eb3 expref: 12 pid: 8632 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.863579:0:8527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790736269.863583:0:8527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790736269.863590:0:8527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f67c1b0f/0x6aae200528fe6aa9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.863614:0:8527:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f67c1b0f/0x6aae200528fe6aa9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.863653:0:8527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790736269.863742:0:8527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+11:2356:x1877722797236736:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 264us (3238us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736269.863751:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 56 00000100:00100000:1.0:1790736269.864304:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3306:x1877722816123776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2072us (6102us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1790736269.864315:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:3.0:1790736269.864674:0:11186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790736269.864688:0:11186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9a369b1/0x6aae200528fe6ab0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.864702:0:11186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60c00 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:3.0:1790736269.864708:0:11186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9a369b1/0x6aae200528fe6ab0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.864730:0:11186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9a369b1/0x6aae200528fe6ab0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.864751:0:11186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9a369b1/0x6aae200528fe6ab0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.864760:0:11186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9a369b1/0x6aae200528fe6ab0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.864794:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736269.864797:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736269.864799:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736269.865087:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f67c1b0f/0x6aae200528fe6aa9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.865121:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f67c1b0f/0x6aae200528fe6aa9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.865133:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f67c1b0f/0x6aae200528fe6aa9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790736269.865136:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94163b30ce00/2, rc 0, transno 4294967304 00010000:00010000:0.0:1790736269.865143:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f67c1b0f/0x6aae200528fe6aa9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736269.865146:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b30ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816123776:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1790736269.865167:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790736269.866201:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736269.866469:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163381b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3309:x1877722816123392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15148us (15389us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1790736269.866483:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790736269.866523:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797236864 00000100:00100000:0.0:1790736269.866539:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797236864 00010000:00010000:2.0:1790736269.866594:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1790736269.866600:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 43 00010000:00010000:2.0:1790736269.866605:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f67c1b0f/0x6aae200528fe6aa9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736269.866610:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162edc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+11:2356:x1877722797236864:12345-192.168.203.5@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1790736269.866619:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642172200 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:2.0:1790736269.866624:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f67c1b0f/0x6aae200528fe6aa9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.866633:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f67c1b0f/0x6aae200528fe6aa9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.866654:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f67c1b0f/0x6aae200528fe6aa9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.866663:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f67c1b0f/0x6aae200528fe6aa9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.866701:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736269.866704:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736269.866706:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1790736269.866883:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94162f7f7b80/2, rc 0, transno 4294967310 00000100:00100000:1.0:1790736269.866898:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f7f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816123392:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1790736269.948222:0:6725:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:1.0:1790736269.948259:0:6725:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1790736269.948266:0:6725:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:2.0:1790736269.948609:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162edc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2356:x1877722797236864:12345-192.168.203.5@tcp:16:lhsmtool_posix.0 Request processed in 81990us (82406us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736269.948623:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 43 00000100:00100000:2.0:1790736269.951214:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736269.951499:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797237120 00000100:00100000:3.0:1790736269.951525:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797237120 00000100:00100000:3.0:1790736269.951614:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 125 00000100:00100000:3.0:1790736269.951628:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+15:10523:x1877722797237120:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790736269.951724:0:8114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790736269.951771:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931800/0x6aae200528fe6a94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f46 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.951802:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94160678ab00) 00010000:00010000:3.0:1790736269.951810:0:8114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790736269.951863:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6ab7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.951886:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6ab7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.951922:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6ab7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790736269.955729:0:8114:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000944d6e73 reply state 00000000ebd3771d transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6ab7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736269.955762:0:8114:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790736269.955981:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+16:10523:x1877722797237120:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 4347us (4777us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1790736269.955992:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 125 00010000:00010000:3.0:1790736269.958914:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6ab7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.958938:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6ab7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.958946:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6ab7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.958953:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c8e00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736269.958960:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6ab7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.958968:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6ab7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.958989:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94160678ab00) 00010000:00010000:3.0:1790736269.958993:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736269.958999:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6ab7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736269.959029:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6ab7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736269.959457:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736269.959627:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797237248 00000100:00100000:1.0:1790736269.959640:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797237248 00000100:00100000:1.0:1790736269.959708:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 44 00000100:00100000:1.0:1790736269.959719:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2355:x1877722797237248:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1790736269.960070:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1790736269.960075:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1790736270 -> 1790736269 00002000:00010000:1.0:1790736269.960077:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1790736269 00002000:00010000:1.0:1790736269.960079:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1790736270 -> 1790736269 00002000:00010000:1.0:1790736269.960082:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1790736269.960214:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+7:2355:x1877722797237248:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 Request processed in 496us (764us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1790736269.960224:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 44 00000100:00100000:0.0:1790736269.963725:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736269.963916:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797237504 00000100:00100000:2.0:1790736269.963929:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797237504 00000100:00100000:2.0:1790736269.964049:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 126 00000100:00100000:2.0:1790736269.964062:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+15:10523:x1877722797237504:12345-192.168.203.5@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1790736269.964188:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6abe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.964211:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe6a78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f38 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.964222:0:5843:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6abe lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.964266:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe6a78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f38 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.964282:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe6a78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f38 expref: 15 pid: 5843 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736269.964326:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b781500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1877722816123904:192.168.203.5@tcp:104: 00000100:00100000:2.0:1790736269.964451:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162f7d7300 going to sleep for 11 seconds 00000100:00100000:3.0:1790736269.968744:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736269.969077:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797237632 00000100:00100000:0.0:1790736269.969090:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797237632 00010000:00010000:0.0:1790736269.969212:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe6a78 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f38 expref: 16 pid: 5843 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736269.969256:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 57 00000100:00100000:0.0:1790736269.969270:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+16:2356:x1877722797237632:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790736269.969290:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790736269.969298:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe6a78 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f38 expref: 16 pid: 5843 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.969313:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe6a78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f38 expref: 16 pid: 5843 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.969356:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94160678ab00) 00010000:00010000:0.0:1790736269.969363:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6abe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.969382:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6abe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.969391:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6abe lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.969416:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790736269.969496:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+16:2356:x1877722797237632:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 228us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736269.970474:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 57 00010000:00010000:2.0:1790736269.971253:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931600/0x6aae200528fe6a78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f38 expref: 15 pid: 5843 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736269.971286:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b781500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1877722816123904:192.168.203.5@tcp:104: 00010000:00010000:2.0:1790736269.971326:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6abe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.971487:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6abe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.971496:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6abe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.971636:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6abe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.971645:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6abe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.971654:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6abe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.971660:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163c526600 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736269.971666:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6abe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.971676:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6abe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.971721:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94160678ab00) 00010000:00010000:2.0:1790736269.971724:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1790736269.971731:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6abe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.971920:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6abe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736269.972245:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+14:10523:x1877722797237504:12345-192.168.203.5@tcp:55:lhsmtool_posix.0 Request processed in 8180us (8530us total) trans 0 rc -22/-22 00000100:00100000:2.0:1790736269.972259:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 126 00000100:00100000:1.0:1790736269.974126:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790736269.974166:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b30ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816124032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790736269.974265:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736269.974409:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816124032 00000100:00100000:0.0:1790736269.974420:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816124032 00000100:00100000:0.0:1790736269.974543:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790736269.974555:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162edc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3309:x1877722816124032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790736269.974585:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 3407872 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790736269.974644:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162edc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3309:x1877722816124032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736269.974653:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790736269.976580:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b30ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816124032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790736269.978872:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736269.979303:0:8632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797237760 00000100:00100000:2.0:1790736269.979317:0:8632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797237760 00000100:00100000:2.0:1790736269.979405:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 45 00000100:00100000:2.0:1790736269.979416:0:8632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+7:2355:x1877722797237760:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1790736269.979476:0:8632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007cbbd4a8/0x6aae200528fe6ac5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.979502:0:8632:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe88ea5f/0x6aae200528fe6aa2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0x92962417a526f54 expref: 7 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.979512:0:8632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790736269.979534:0:8632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790736269.979540:0:8632:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cbbd4a8/0x6aae200528fe6ac5 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.979587:0:8632:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fe88ea5f/0x6aae200528fe6aa2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.5@tcp remote: 0x92962417a526f54 expref: 7 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736269.979626:0:8632:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fe88ea5f/0x6aae200528fe6aa2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a526f54 expref: 7 pid: 8632 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736269.979646:0:8632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b781500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8632:1877722816124160:192.168.203.5@tcp:104: 00000100:00100000:2.0:1790736269.979766:0:8632:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162f7d7300 going to sleep for 11 seconds 00000100:00100000:2.0:1790736269.983749:0:8632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b781500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8632:1877722816124160:192.168.203.5@tcp:104: 00010000:00010000:2.0:1790736269.983790:0:8632:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007cbbd4a8/0x6aae200528fe6ac5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736269.985278:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736269.985792:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797237888 00000100:00100000:0.0:1790736269.985814:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797237888 00010000:00010000:0.0:1790736269.985869:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fe88ea5f/0x6aae200528fe6aa2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a526f54 expref: 8 pid: 8632 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736269.985921:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 58 00000100:00100000:0.0:1790736269.985932:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+8:2355:x1877722797237888:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790736269.985951:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790736269.985981:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fe88ea5f/0x6aae200528fe6aa2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a526f54 expref: 8 pid: 8632 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.985996:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fe88ea5f/0x6aae200528fe6aa2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a526f54 expref: 8 pid: 8632 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.986026:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe88ea5f/0x6aae200528fe6aa2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.5@tcp remote: 0x92962417a526f54 expref: 8 pid: 8632 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.986074:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790736269.986080:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790736269.986089:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007cbbd4a8/0x6aae200528fe6ac5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.986176:0:5829:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cbbd4a8/0x6aae200528fe6ac5 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736269.986210:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790736269.986279:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+7:2355:x1877722797237888:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 347us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736269.986288:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 58 00010000:00010000:1.0:1790736269.986571:0:8632:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007cbbd4a8/0x6aae200528fe6ac5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.986583:0:8632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cbbd4a8/0x6aae200528fe6ac5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.986635:0:8632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007cbbd4a8/0x6aae200528fe6ac5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.986646:0:8632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007cbbd4a8/0x6aae200528fe6ac5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.986654:0:8632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007cbbd4a8/0x6aae200528fe6ac5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.986662:0:8632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163c526600 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:1.0:1790736269.986667:0:8632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007cbbd4a8/0x6aae200528fe6ac5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.986677:0:8632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007cbbd4a8/0x6aae200528fe6ac5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.986692:0:8632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007cbbd4a8/0x6aae200528fe6ac5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.986700:0:8632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cbbd4a8/0x6aae200528fe6ac5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736269.986758:0:8632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2355:x1877722797237760:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 7343us (7905us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736269.986767:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 45 00000100:00100000:3.0:1790736269.992566:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736269.992922:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797238144 00000100:00100000:1.0:1790736269.992936:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797238144 00000100:00100000:1.0:1790736269.993014:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 127 00000100:00100000:1.0:1790736269.993026:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+14:10523:x1877722797238144:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1790736269.993173:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6acc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.993196:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6acc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.993213:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6acc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.994062:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe6ad3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.994085:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe6a86 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f3f expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.994136:0:5844:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe6ad3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.994191:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe6a86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f3f expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736269.994212:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe6a86 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f3f expref: 15 pid: 5843 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736269.994230:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162edc6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1877722816124288:192.168.203.5@tcp:104: 00000100:00100000:1.0:1790736269.994369:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607c03480 going to sleep for 11 seconds 00000100:00100000:3.0:1790736270.000370:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736270.000543:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162edc6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1877722816124288:192.168.203.5@tcp:104: 00010000:00010000:1.0:1790736270.000581:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe6ad3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736270.000946:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797238272 00000100:00100000:0.0:1790736270.000969:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797238272 00010000:00010000:0.0:1790736270.001043:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe6a86 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f3f expref: 16 pid: 5843 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736270.001126:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 59 00000100:00100000:0.0:1790736270.001140:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+16:2356:x1877722797238272:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790736270.001163:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790736270.001171:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe6a86 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f3f expref: 16 pid: 5843 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736270.001186:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe6a86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f3f expref: 16 pid: 5843 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736270.001238:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611930c00/0x6aae200528fe6a86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f3f expref: 16 pid: 5843 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736270.001256:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94160678ab00) 00010000:00010000:0.0:1790736270.001263:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe6ad3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736270.001273:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe6ad3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736270.001283:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe6ad3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736270.001315:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790736270.001396:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+15:2356:x1877722797238272:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 259us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736270.001405:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 59 00010000:00010000:3.0:1790736270.001819:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe6ad3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736270.001828:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe6ad3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790736270.002074:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:3.0:1790736270.002307:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1790736270.002359:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:3.0:1790736270.002473:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633e87800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5844:1877722816124416:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1790736270.002569:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736270.002614:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff94160822ff00 going to sleep for 11 seconds 00000100:00080000:2.0:1790736270.003293:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790736270.003419:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816124416 00000100:00100000:0.0:1790736270.003432:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816124416 00000100:00100000:0.0:1790736270.003500:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790736270.003511:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1877722816124416:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1790736270.003672:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1877722816124416:12345-0@lo:1000:mdt00_001.0 Request processed in 162us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736270.003680:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790736270.003970:0:5844:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1790736270.003978:0:5844:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:2.0:1790736270.004004:0:5844:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94162f7f4700, transno 4294967309 00000004:00080000:2.0:1790736270.004020:0:5844:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94162f7f7b80, transno 4294967310 00000100:00100000:2.0:1790736270.004028:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633e87800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5844:1877722816124416:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1790736270.004673:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1790736270.004772:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b781500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5844:1877722816124544:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1790736270.005430:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736270.005484:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162f7d7480 going to sleep for 11 seconds 00000100:00100000:3.0:1790736270.007060:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816124544 00000100:00100000:3.0:1790736270.007083:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816124544 00000100:00100000:3.0:1790736270.007171:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790736270.007181:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1877722816124544:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1790736270.007870:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5844:x1877722816124544:12345-0@lo:1000:mdt00_001.0 Request processed in 616us (2369us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1790736270.007881:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790736270.008648:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b781500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5844:1877722816124544:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1790736270.008720:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe6ad3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736270.008743:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe6ad3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736270.008779:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe6ad3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736270.008786:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60200 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736270.008793:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe6ad3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736270.009959:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe6ad3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736270.009990:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94160678ab00) 00010000:00010000:2.0:1790736270.009994:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790736270.010001:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe6ad3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736270.010011:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe6ad3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736270.010079:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6a16 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736270.010087:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6a16 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736270.010113:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6a16 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736270.010119:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941611930400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736270.010122:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6a16 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736270.010158:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6a16 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736270.010168:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff941603253d00) 00010000:00010000:2.0:1790736270.010171:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790736270.010183:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe6a1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f23 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736270.010197:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe6a1d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f23 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736270.010209:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe6a1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f23 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736270.010265:0:5844:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe6a1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f23 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736270.010287:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163393c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1877722816124672:192.168.203.5@tcp:105: 00000100:00100000:2.0:1790736270.011833:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162f7d7480 going to sleep for 11 seconds 00000100:00100000:3.0:1790736270.023475:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736270.024158:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797238400 00000100:00100000:0.0:1790736270.024175:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797238400 00000100:00100000:0.0:1790736270.024255:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 31 00000100:00100000:0.0:1790736270.024268:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+19:10522:x1877722797238400:12345-192.168.203.5@tcp:49:lfs.0 00000100:00100000:0.0:1790736270.024501:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+19:10522:x1877722797238400:12345-192.168.203.5@tcp:49:lfs.0 Request processed in 234us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736270.024511:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 31 00000100:00100000:1.0:1790736270.028427:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736270.028643:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797238656 00000100:00100000:0.0:1790736270.028660:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797238656 00000100:00100000:3.0:1790736270.028869:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 128 00000100:00100000:3.0:1790736270.028884:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162edc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+19:10522:x1877722797238656:12345-192.168.203.5@tcp:58:lfs.0 00000040:00080000:3.0:1790736270.029475:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1790736270.029617:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162edc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+19:10522:x1877722797238656:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 734us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736270.029627:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 128 00000100:00100000:2.0:1790736270.033771:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163393c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1877722816124672:192.168.203.5@tcp:105: 00010000:00010000:2.0:1790736270.033829:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6a16 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736270.033845:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe6a16 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.034761:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6ada lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.034790:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6ada lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.034816:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6ada lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.034830:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6ada lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.034838:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6ada lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.034845:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6ada lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.034852:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c61800 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736270.034857:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6ada lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.034865:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6ada lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.034878:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff941603253d00) 00010000:00010000:1.0:1790736270.034882:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736270.034904:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6ada lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.034911:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6ada lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.034926:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6acc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.034932:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6acc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.034938:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6acc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.034943:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c61c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736270.034946:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6acc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.034952:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6acc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.034960:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff941603253d00) 00010000:00010000:1.0:1790736270.034963:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790736270.034966:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6acc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.034972:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6acc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736270.035325:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+18:10523:x1877722797238144:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 42296us (42767us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1790736270.035339:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 127 00000020:00080000:1.0:1790736270.035352:0:5844:0:(tgt_main.c:787:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1790736270.036030:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790736270.036038:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790736270.036075:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1790736270.036084:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790736270.040759:0:11704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b30d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11704:1877722816124800:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790736270.044090:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736270.044311:0:11704:0:(client.c:2716:ptlrpc_set_wait()) set ffff941637e9b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790736270.048703:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797238912 00000100:00100000:2.0:1790736270.048753:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797238912 00000100:00100000:2.0:1790736270.048842:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 32 00000100:00100000:2.0:1790736270.048855:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416114ef450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+19:10523:x1877722797238912:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1790736270.049744:0:5847:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1790736270.049876:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1790736270.049934:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526e00/0x6aae200528fe6ae1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736270.049958:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526e00/0x6aae200528fe6ae1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736270.049971:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526e00/0x6aae200528fe6ae1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736270.049981:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526e00/0x6aae200528fe6ae1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736270.049989:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526e00/0x6aae200528fe6ae1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736270.049995:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526e00/0x6aae200528fe6ae1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736270.050018:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790736270.050191:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416114ef450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+21:10523:x1877722797238912:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 1334us (6118us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1790736270.050201:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 32 00000020:00080000:2.0:1790736270.050208:0:5847:0:(tgt_main.c:787:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790736270.052319:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790736270.052338:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526e00/0x6aae200528fe6ae1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.052363:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163c526e00 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:1.0:1790736270.052367:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526e00/0x6aae200528fe6ae1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.052379:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526e00/0x6aae200528fe6ae1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.052401:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94160678ab00) 00010000:00010000:1.0:1790736270.052404:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790736270.052410:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526e00/0x6aae200528fe6ae1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.052417:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526e00/0x6aae200528fe6ae1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.052453:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736270.052455:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736270.052457:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790736270.058512:0:11704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b30d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11704:1877722816124800:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790736270.063671:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736270.064132:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797239040 00000100:00100000:1.0:1790736270.064148:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797239040 00000100:00100000:1.0:1790736270.064215:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 129 00000100:00100000:1.0:1790736270.064227:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+20:10524:x1877722797239040:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790736270.064290:0:8114:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790736270.064423:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+20:10524:x1877722797239040:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 199us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736270.064442:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 129 00000100:00100000:1.0:1790736270.071405:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736270.071528:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797239296 00000100:00100000:0.0:1790736270.071609:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797239296 00000100:00100000:0.0:1790736270.071700:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 130 00000100:00100000:0.0:1790736270.071714:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162edc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+20:10524:x1877722797239296:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790736270.072038:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736270.072068:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6ae8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526f5b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736270.072702:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe6aef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736270.072724:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe6aef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736270.073281:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe6aef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790736270.073324:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1790736270.074044:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6ae8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f5b expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736270.074075:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe6aef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f5b expref: 22 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736270.074086:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff941603253d00) 00010000:00010000:0.0:1790736270.074090:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790736270.074127:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941642173600, rc 0) 00000100:00100000:0.0:1790736270.074256:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162edc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+22:10524:x1877722797239296:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 2544us (2862us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1790736270.074266:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 130 00000100:00100000:2.0:1790736270.085891:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736270.086057:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797239552 00000100:00100000:1.0:1790736270.086068:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797239552 00000100:00100000:1.0:1790736270.086157:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 131 00000100:00100000:1.0:1790736270.086167:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163393c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+22:10524:x1877722797239552:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1790736270.086250:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6afd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.086269:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6afd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.086281:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6afd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.086979:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6afd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.086990:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6afd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.086999:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6afd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.087005:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c61c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736270.087009:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6afd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.087017:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6afd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.087046:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff941603253d00) 00010000:00010000:1.0:1790736270.087049:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790736270.087055:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6afd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.087062:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6afd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736270.087270:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163393c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+23:10524:x1877722797239552:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 1103us (1387us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1790736270.087280:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 131 00000040:00080000:0.0:1790736270.088937:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790736270.088950:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790736270.089482:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1790736270.089494:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790736270.092868:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736270.096873:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797239808 00000100:00100000:2.0:1790736270.096889:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797239808 00000100:00100000:2.0:1790736270.097244:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 33 00000100:00100000:2.0:1790736270.097255:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+23:10524:x1877722797239808:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790736270.097828:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+24:10524:x1877722797239808:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 572us (4965us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1790736270.097836:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 33 00010000:00010000:3.0:1790736270.101386:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736270.103757:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736270.103860:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797239936 00000100:00100000:3.0:1790736270.103869:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797239936 00000100:00100000:3.0:1790736270.103997:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 132 00000100:00100000:3.0:1790736270.104007:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160312ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+24:10526:x1877722797239936:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1790736270.104032:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736270.104053:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6b04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526f62 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736270.108201:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6b0b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736270.108227:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6b0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736270.108246:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6b0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736270.108262:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6b12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736270.108307:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6b12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736270.108451:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6b12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736270.108724:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe6b19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736270.108739:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe6a08 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f1c expref: 25 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736270.108748:0:5844:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe6b19 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736270.109439:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe6a08 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f1c expref: 25 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736270.109460:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe6a08 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f1c expref: 25 pid: 5845 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736270.109477:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163c522d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1877722816124928:192.168.203.5@tcp:104: 00000100:00100000:3.0:1790736270.110421:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416120c9780 going to sleep for 11 seconds 00000100:00100000:0.0:1790736270.118871:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736270.119087:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163c522d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1877722816124928:192.168.203.5@tcp:104: 00010000:00010000:3.0:1790736270.119343:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe6b19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736270.119436:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797240192 00000100:00100000:1.0:1790736270.119444:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797240192 00000100:00100000:1.0:1790736270.119527:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 34 00000100:00100000:1.0:1790736270.119538:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+26:5592:x1877722797240192:12345-192.168.203.5@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790736270.119838:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+27:5592:x1877722797240192:12345-192.168.203.5@tcp:35:ldlm_bl.0 Request processed in 300us (977us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1790736270.119848:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 34 00000100:00100000:1.0:1790736270.124869:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736270.127616:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797240320 00000100:00100000:0.0:1790736270.127632:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797240320 00010000:00010000:0.0:1790736270.127693:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe6a08 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f1c expref: 27 pid: 5845 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736270.127745:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 60 00000100:00100000:0.0:1790736270.127754:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160557c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+27:2356:x1877722797240320:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790736270.127770:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790736270.127791:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe6a08 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f1c expref: 27 pid: 5845 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736270.127804:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe6a08 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f1c expref: 27 pid: 5845 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736270.127826:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe6a08 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f1c expref: 27 pid: 5845 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736270.127843:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff941603253d00) 00010000:00010000:0.0:1790736270.127848:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe6b19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736270.127859:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe6b19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736270.127867:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe6b19 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736270.127910:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790736270.127980:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160557c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+26:2356:x1877722797240320:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 227us (3120us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736270.127989:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 60 00010000:00010000:1.0:1790736270.128558:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe6b19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.128569:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe6b19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790736270.128617:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1790736270.128622:0:5844:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790736270.128660:0:5844:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe6b19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.128673:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe6b19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.128683:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6b0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.128690:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6b0b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.128698:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6b0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.128704:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c8e00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736270.128708:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6b0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.128717:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6b0b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.128728:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94161505d100) 00010000:00010000:1.0:1790736270.128731:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736270.128736:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6b0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.128743:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6b0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.128754:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6b12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.128760:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6b12 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.128772:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6b12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.128777:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c9a00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736270.128780:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6b12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.128786:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6b12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.128794:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94161505d300) 00010000:00010000:1.0:1790736270.128796:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736270.128799:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6b12 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.128805:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6b12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.128847:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6b04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f62 expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.128861:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe6b19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f62 expref: 25 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736270.128869:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff941603253d00) 00010000:00010000:1.0:1790736270.128870:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790736270.128873:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c8c00, rc 0) 00000100:00100000:1.0:1790736270.128924:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160312ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+25:10526:x1877722797239936:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 24918us (25177us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736270.128939:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 132 00000001:00080000:0.0:1790736270.566264:0:7658:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1790736270.566295:0:7658:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1790736270.566302:0:7658:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00010000:00010000:2.0:1790736271.133418:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790736271.273449:0:12078:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790736271.273462:0:12078:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790736271.274537:0:12078:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1790736271.274547:0:12078:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790736271.399317:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736271.399417:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797240576 00000100:00100000:3.0:1790736271.399451:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797240576 00000100:00100000:3.0:1790736271.399543:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 133 00000100:00100000:3.0:1790736271.399557:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160312d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+25:10549:x1877722797240576:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1790736271.399604:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736271.399645:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe6b20 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526f69 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736271.399786:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9000/0x6aae200528fe6b27 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736271.399805:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9000/0x6aae200528fe6b27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736271.399819:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9000/0x6aae200528fe6b27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790736271.399833:0:8114:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1790736271.400009:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe6b20 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f69 expref: 28 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736271.400033:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9000/0x6aae200528fe6b27 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f69 expref: 27 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736271.400044:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff941603253d00) 00010000:00010000:3.0:1790736271.400047:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1790736271.400051:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c9000, rc 0) 00000100:00100000:3.0:1790736271.400169:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160312d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+27:10549:x1877722797240576:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 615us (866us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1790736271.400178:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 133 00000100:00100000:3.0:1790736271.403012:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736271.403147:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797240704 00000100:00100000:2.0:1790736271.403161:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797240704 00000100:00100000:2.0:1790736271.403231:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 134 00000100:00100000:2.0:1790736271.403243:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+27:10549:x1877722797240704:12345-192.168.203.5@tcp:54:lfs.0 00010000:00010000:2.0:1790736271.403343:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526400/0x6aae200528fe6b35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736271.403365:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526400/0x6aae200528fe6b35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736271.403378:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526400/0x6aae200528fe6b35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736271.403410:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526400/0x6aae200528fe6b35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736271.403419:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526400/0x6aae200528fe6b35 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736271.403427:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526400/0x6aae200528fe6b35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736271.403451:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163c526400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736271.403457:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526400/0x6aae200528fe6b35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736271.403465:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526400/0x6aae200528fe6b35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736271.403479:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff941603253d00) 00010000:00010000:2.0:1790736271.403482:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790736271.403488:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526400/0x6aae200528fe6b35 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736271.403494:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526400/0x6aae200528fe6b35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736271.403597:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+27:10549:x1877722797240704:12345-192.168.203.5@tcp:54:lfs.0 Request processed in 355us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736271.403606:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 134 00000100:00100000:1.0:1790736271.504907:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736271.509010:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797240832 00000100:00100000:2.0:1790736271.509035:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797240832 00000100:00100000:2.0:1790736271.509423:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 46 00000100:00100000:2.0:1790736271.509437:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160312c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2354:x1877722797240832:12345-192.168.203.5@tcp:101:cat.0 00010000:00010000:2.0:1790736271.510357:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736271.510392:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a196d76d/0x6aae200528fe6b3c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526f70 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790736271.510430:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6abc778d, atime: 0x6abc778d, ctime: 0x6abc778d, blocks: 0xb 00010000:00010000:2.0:1790736271.510470:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=343s v=(0 0) 00010000:00010000:2.0:1790736271.510493:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790736271.510518:0:6697:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a196d76d/0x6aae200528fe6b3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f70 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736271.510545:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a196d76d/0x6aae200528fe6b3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f70 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736271.510561:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94163c526400, rc 0) 00000100:00100000:2.0:1790736271.510649:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160312c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+7:2354:x1877722797240832:12345-192.168.203.5@tcp:101:cat.0 Request processed in 1215us (5757us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736271.510657:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 46 00000100:00080000:0.0:1790736271.512607:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790736271.514313:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736271.514693:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797240960 00000100:00100000:0.0:1790736271.514707:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797240960 00002000:00100000:0.0:1790736271.514847:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff94163393d180 x1877722797240960/t0(0) o3->f945944d-9086-46a2-a91c-8bc7b88e8918@192.168.203.5@tcp:102/0 lens 488/0 e 0 to 0 dl 1790736282 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790736271.514880:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94163393d180 with x1877722797240960 ext(0->4095) 00002000:00010000:0.0:1790736271.514889:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94163393d180 00000100:00100000:0.0:1790736271.514977:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3 00000100:00100000:0.0:1790736271.514989:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163393d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+7:2353:x1877722797240960:12345-192.168.203.5@tcp:3:cat.0 00000100:00100000:0.0:1790736271.515326:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163393d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+7:2353:x1877722797240960:12345-192.168.203.5@tcp:3:cat.0 Request processed in 337us (1026us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1790736271.515334:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3 00002000:00100000:0.0:1790736271.515343:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff94163393d180 x1877722797240960/t0(0) o3->f945944d-9086-46a2-a91c-8bc7b88e8918@192.168.203.5@tcp:102/0 lens 488/4536 e 0 to 0 dl 1790736282 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790736271.515351:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94163393d180 with x1877722797240960 ext(0->4095) 00002000:00010000:0.0:1790736271.515355:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94163393d180 00010000:00010000:1.0:1790736272.149901:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736273.177233:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790736273.570909:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163c521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816125056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790736273.570990:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736273.577427:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816125056 00000100:00100000:3.0:1790736273.577443:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816125056 00000100:00100000:1.0:1790736273.577819:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790736273.577829:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163393f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1877722816125056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790736273.577873:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790736273.577957:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163393f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1877722816125056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (6966us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736273.577964:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790736273.579353:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163c521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816125056:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790736273.588819:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790736274.200791:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736274.431402:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736274.432339:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797241088 00000100:00100000:1.0:1790736274.432351:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797241088 00000100:00100000:1.0:1790736274.432413:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 290 00000100:00100000:1.0:1790736274.432424:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606654450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+13:2356:x1877722797241088:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1790736274.432513:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606654450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+13:2356:x1877722797241088:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 90us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736274.432519:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 290 00000100:00100000:1.0:1790736274.436160:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736274.436199:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736274.436219:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797241216 00000100:00100000:1.0:1790736274.436224:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797241472 00000100:00100000:3.0:1790736274.436228:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797241216 00000100:00100000:1.0:1790736274.436228:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797241472 00000100:00100000:1.0:1790736274.436293:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 79 00000100:00100000:1.0:1790736274.436302:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160312d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2355:x1877722797241472:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1790736274.436371:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160312d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2355:x1877722797241472:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 70us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736274.436391:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 79 00000100:00080000:1.0:1790736274.437672:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790736274.437680:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790736274.438727:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 140 00000100:00100000:1.0:1790736274.438746:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160312ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+27:2355:x1877722797241216:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1790736274.438838:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160312ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+27:2355:x1877722797241216:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 101us (2688us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736274.438845:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 140 00000100:00100000:1.0:1790736274.441360:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736274.441400:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736274.442370:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797241600 00000100:00100000:2.0:1790736274.442382:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797241600 00000100:00100000:2.0:1790736274.442442:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 141 00000100:00100000:2.0:1790736274.442452:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2356:x1877722797241600:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1790736274.442548:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2356:x1877722797241600:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 97us (1146us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736274.442556:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 141 00000100:00100000:0.0:1790736274.442711:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797241344 00000100:00100000:0.0:1790736274.442719:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797241344 00000100:00100000:0.0:1790736274.442760:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 80 00000100:00100000:0.0:1790736274.442769:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+7:2356:x1877722797241344:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1790736274.442806:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+7:2356:x1877722797241344:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 40us (1457us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736274.442812:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 80 00000100:00080000:0.0:1790736274.443300:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790736274.443314:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790736274.581478:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941635cf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1877722816125440:0@lo:400:kworker.0 00000100:00100000:0.0:1790736274.581570:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736274.581633:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790736274.581647:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941635cfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816125568:0@lo:400:kworker.0 00000100:00100000:0.0:1790736274.581675:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736274.581712:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816125568 00000100:00100000:0.0:1790736274.581720:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816125568 00000100:00100000:0.0:1790736274.581764:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1790736274.581773:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1877722816125568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736274.581820:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1877722816125568:12345-0@lo:400:kworker.0 Request processed in 48us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736274.581827:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1790736274.581880:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941635cfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816125568:0@lo:400:kworker.0 00000100:00100000:2.0:1790736274.582084:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816125440 00000100:00100000:2.0:1790736274.582089:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816125440 00000100:00100000:2.0:1790736274.582153:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1790736274.582160:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877722816125440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736274.582201:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877722816125440:12345-0@lo:400:kworker.0 Request processed in 42us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736274.582215:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1790736274.582395:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163393e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816125184:0@lo:400:kworker.0 00000100:00100000:3.0:1790736274.582432:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736274.582468:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941635cfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1877722816125696:0@lo:400:kworker.0 00000100:00100000:3.0:1790736274.582512:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736274.582534:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1790736274.582540:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877722816125312:0@lo:400:kworker.0 00000100:00100000:3.0:1790736274.582562:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736274.582576:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94150133fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816125824:0@lo:400:kworker.0 00000100:00100000:3.0:1790736274.582599:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736274.582627:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816125696 00000100:00100000:3.0:1790736274.582631:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816125696 00000100:00100000:3.0:1790736274.582656:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816125312 00000100:00100000:3.0:1790736274.582659:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816125312 00000100:00100000:3.0:1790736274.582673:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1790736274.582680:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877722816125696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736274.582716:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877722816125696:12345-0@lo:400:kworker.0 Request processed in 36us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736274.582722:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1790736274.582735:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1790736274.582750:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c521c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877722816125312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736274.582777:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c521c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877722816125312:12345-0@lo:400:kworker.0 Request processed in 27us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736274.582782:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1790736274.582812:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877722816125312:0@lo:400:kworker.0 00000100:00100000:3.0:1790736274.582820:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941635cfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1877722816125696:0@lo:400:kworker.0 00000100:00100000:2.0:1790736274.582939:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816125184 00000100:00100000:2.0:1790736274.582944:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816125184 00000100:00100000:2.0:1790736274.582978:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1790736274.582985:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606655050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+19:3306:x1877722816125184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736274.583022:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606655050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+19:3306:x1877722816125184:12345-0@lo:400:kworker.0 Request processed in 38us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736274.583029:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1790736274.583354:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163393e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816125184:0@lo:400:kworker.0 00000100:00080000:0.0:1790736274.583426:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790736274.583440:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816125824 00000100:00100000:0.0:1790736274.583444:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816125824 00000100:00080000:2.0:1790736274.583576:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790736274.583613:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790736274.583623:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c523800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816125824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736274.583681:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c523800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816125824:12345-0@lo:400:kworker.0 Request processed in 61us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736274.583689:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790736274.583727:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941635cf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1877722816125440:0@lo:400:kworker.0 00000100:00100000:2.0:1790736274.583786:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1790736274.583793:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:2.0:1790736274.583809:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94163380d880, transno 4294967301 00000004:00080000:2.0:1790736274.583826:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1790736274.583836:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94163b30ce00, transno 4294967304 00000100:00100000:2.0:1790736274.583841:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94150133fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816125824:0@lo:400:kworker.0 00000100:00100000:3.0:1790736275.104701:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790736275.104736:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b6c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816125952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790736275.104818:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736275.105465:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816125952 00000100:00100000:1.0:1790736275.105487:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816125952 00000100:00100000:1.0:1790736275.105553:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790736275.105564:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c520e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816125952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790736275.105604:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790736275.105664:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c520e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816125952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736275.105671:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790736275.111723:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b6c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816125952:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1790736275.137046:0:6725:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:3.0:1790736275.137068:0:6725:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:0.0:1790736275.177656:0:12038:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967409 is committed 00000020:00080000:0.0:1790736275.177672:0:12038:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:0.0:1790736275.177685:0:12038:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:0.0:1790736275.177756:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000020:00080000:0.0:1790736275.177767:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000020:00080000:0.0:1790736275.178000:0:12037:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff94162f7d76c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1790736275.178006:0:12037:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94163ad0f500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff94162f7d7300 00000020:00080000:0.0:1790736275.178026:0:12037:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94163ad0fb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94162f52ac00 00000020:00080000:3.0:1790736275.178040:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000001:00080000:1.0:1790736275.178261:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1790736275.178290:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:1.0:1790736275.222867:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736276.245689:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736276.879689:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736276.879804:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797241728 00000100:00100000:3.0:1790736276.879815:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797241728 00000100:00080000:2.0:1790736276.879978:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790736276.880762:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 135 00000100:00100000:3.0:1790736276.880777:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+14:10211:x1877722797241728:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1790736276.880891:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+14:10211:x1877722797241728:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 Request processed in 119us (1215us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736276.880899:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 135 00000100:00100000:2.0:1790736276.893214:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736276.893349:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797241984 00000100:00100000:0.0:1790736276.893360:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797241984 00000100:00100000:0.0:1790736276.893475:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 35 00000100:00100000:0.0:1790736276.893485:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94150133fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+14:10211:x1877722797241984:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790736276.893820:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94150133fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+15:10211:x1877722797241984:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 336us (616us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1790736276.893828:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 35 00010000:00010000:1.0:1790736277.269447:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790736278.294050:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790736278.294058:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790736278.294336:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1790736278.294343:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1790736278.300336:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790736278.680510:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94150133c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816126080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790736278.680586:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736278.683554:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816126080 00000100:00100000:2.0:1790736278.683568:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816126080 00000100:00100000:2.0:1790736278.683663:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790736278.683798:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94150133d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816126080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790736278.683839:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790736278.683918:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94150133d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816126080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 246us (3333us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736278.683925:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790736278.683967:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1790736278.683972:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1790736278.684002:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94150133c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816126080:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790736278.684607:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1790736278.750504:0:12279:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 22:44:37 (1790736277) 00010000:00010000:3.0:1790736279.317553:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790736279.553967:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736279.554035:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736279.554072:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736279.554153:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736279.554195:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736279.554428:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797242112 00000100:00100000:1.0:1790736279.554440:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797242112 00000100:00100000:1.0:1790736279.554652:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 292 00000100:00100000:1.0:1790736279.554680:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606655c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+13:2354:x1877722797242112:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1790736279.554763:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606655c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+13:2354:x1877722797242112:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 100us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736279.554772:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 292 00000100:00100000:0.0:1790736279.554828:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797242368 00000100:00100000:0.0:1790736279.554837:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797242368 00000100:00100000:0.0:1790736279.554899:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797242496 00000100:00100000:0.0:1790736279.554903:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797242496 00000100:00100000:0.0:1790736279.554933:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 83 00000100:00100000:0.0:1790736279.554944:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94150133c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2354:x1877722797242368:12345-192.168.203.5@tcp:400:kworker.0 00000100:00080000:1.0:1790736279.559087:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790736279.559113:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790736279.559150:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 84 00000100:00100000:3.0:1790736279.559155:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797242624 00000100:00100000:3.0:1790736279.559166:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797242624 00000100:00100000:1.0:1790736279.559172:0:8632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94150133ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2354:x1877722797242496:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736279.559233:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797242240 00000100:00100000:3.0:1790736279.559238:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797242240 00000100:00100000:1.0:1790736279.559262:0:8632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94150133ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2354:x1877722797242496:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 101us (5065us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736279.559270:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 145 00000100:00100000:1.0:1790736279.559275:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 84 00000100:00100000:3.0:1790736279.559281:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94150133d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2354:x1877722797242624:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736279.559321:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94150133d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2354:x1877722797242624:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 42us (5248us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736279.559329:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 145 00000100:00100000:3.0:1790736279.559345:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 146 00000100:00100000:3.0:1790736279.559352:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94150133c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+15:2354:x1877722797242240:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736279.559433:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94150133c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+15:2354:x1877722797242240:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 81us (5282us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736279.559441:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 146 00000100:00080000:1.0:1790736279.559977:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790736279.561587:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94150133c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2354:x1877722797242368:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 6622us (7528us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736279.561607:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 83 00000100:00100000:2.0:1790736279.703193:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94150133dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1877722816126464:0@lo:400:kworker.0 00000100:00100000:2.0:1790736279.703288:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736279.703434:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94150133ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877722816126336:0@lo:400:kworker.0 00000100:00100000:3.0:1790736279.703526:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94150133f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816126208:0@lo:400:kworker.0 00000100:00100000:0.0:1790736279.703601:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94150133f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816126592:0@lo:400:kworker.0 00000100:00100000:1.0:1790736279.706747:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736279.706817:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94150133e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816126848:0@lo:400:kworker.0 00000100:00100000:1.0:1790736279.706850:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736279.706944:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816126464 00000100:00100000:1.0:1790736279.706952:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816126464 00000100:00100000:1.0:1790736279.706999:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816126336 00000100:00100000:1.0:1790736279.707002:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816126336 00000100:00100000:1.0:1790736279.707026:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1790736279.707034:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94150133e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877722816126464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736279.707084:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94150133e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877722816126464:12345-0@lo:400:kworker.0 Request processed in 51us (3796us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736279.707108:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1790736279.707126:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1790736279.707132:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877722816126336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736279.707201:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877722816126336:12345-0@lo:400:kworker.0 Request processed in 69us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736279.707207:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:1.0:1790736279.707245:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790736279.707258:0:8632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816126848 00000100:00100000:1.0:1790736279.707261:0:8632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816126848 00000100:00100000:1.0:1790736279.707299:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1790736279.707305:0:8632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816126848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736279.707336:0:8632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816126848:12345-0@lo:400:kworker.0 Request processed in 32us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736279.707353:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1790736279.707368:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790736279.707394:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94150133ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877722816126336:0@lo:400:kworker.0 00000100:00100000:1.0:1790736279.707404:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94150133e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816126848:0@lo:400:kworker.0 00000100:00100000:2.0:1790736279.712686:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94150133dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1877722816126464:0@lo:400:kworker.0 00000100:00100000:3.0:1790736279.712860:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736279.712965:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94150133ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1877722816126720:0@lo:400:kworker.0 00000100:00100000:3.0:1790736279.713002:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736279.714620:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736279.714998:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816126720 00000100:00100000:2.0:1790736279.715018:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816126720 00000100:00100000:3.0:1790736279.715147:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816126592 00000100:00100000:3.0:1790736279.715158:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816126592 00000100:00100000:2.0:1790736279.715164:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1790736279.715181:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163393e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877722816126720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736279.715228:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1790736279.715243:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816126592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736279.715307:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163393e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877722816126720:12345-0@lo:400:kworker.0 Request processed in 131us (2302us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736279.715315:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1790736279.715393:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94150133ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1877722816126720:0@lo:400:kworker.0 00000100:00080000:0.0:1790736279.715482:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790736279.715677:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94150133f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816126592:0@lo:400:kworker.0 00000100:00100000:3.0:1790736279.715723:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816126592:12345-0@lo:400:kworker.0 Request processed in 331us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736279.715732:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1790736279.716908:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816126208 00000100:00100000:1.0:1790736279.716922:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816126208 00000100:00100000:1.0:1790736279.716986:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1790736279.716996:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606655850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+19:3306:x1877722816126208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736279.717227:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606655850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52e04a2b-4e01-44b7-985c-7db034e22389+19:3306:x1877722816126208:12345-0@lo:400:kworker.0 Request processed in 98us (4239us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736279.717237:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1790736279.717403:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94150133f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816126208:0@lo:400:kworker.0 00000100:00100000:0.0:1790736280.214163:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790736280.214198:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b30ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816126976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790736280.214542:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736280.215522:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816126976 00000100:00100000:2.0:1790736280.215534:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816126976 00000100:00100000:2.0:1790736280.215595:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790736280.215604:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816126976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790736280.215645:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790736280.215730:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816126976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736280.215739:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790736280.215942:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b30ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816126976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790736280.261242:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736280.261421:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797242880 00000100:00100000:3.0:1790736280.261437:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797242880 00000100:00100000:0.0:1790736280.261659:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 136 00000100:00100000:0.0:1790736280.261675:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94150133ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+15:11263:x1877722797242880:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790736280.261698:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736280.261723:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe6b43 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526f77 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736280.261810:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6b4a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736280.261827:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6b4a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736280.261852:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6b4a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736280.261914:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6b51 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736280.261923:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6b51 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736280.261931:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6b51 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736280.262212:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6b58 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736280.262223:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6b58 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736280.262230:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6b58 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790736280.262251:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1790736280.262408:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6b4a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736280.262417:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6b4a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736280.262425:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6b4a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736280.262432:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642173e00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736280.262436:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6b4a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736280.262455:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6b4a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736280.262467:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff941603253400) 00010000:00010000:0.0:1790736280.262470:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736280.262479:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6b4a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736280.262486:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6b4a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736280.262499:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6b51 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736280.262505:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6b51 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736280.262522:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6b51 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736280.262527:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642173c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736280.262530:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6b51 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736280.262535:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6b51 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736280.262543:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff941605242d00) 00010000:00010000:0.0:1790736280.262545:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736280.262548:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6b51 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736280.262554:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6b51 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736280.262899:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe6b43 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f77 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736280.262914:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6b58 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f77 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736280.262921:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94160678a900) 00010000:00010000:0.0:1790736280.262923:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736280.262926:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941642172200, rc 0) 00000100:00100000:0.0:1790736280.262989:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94150133ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+17:11263:x1877722797242880:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 1318us (1766us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1790736280.263006:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 136 00000100:00100000:3.0:1790736280.269201:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736280.270576:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797243008 00000100:00100000:2.0:1790736280.270595:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797243008 00000100:00100000:2.0:1790736280.270683:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 137 00000100:00100000:2.0:1790736280.270695:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+17:11263:x1877722797243008:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1790736280.270835:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+17:11263:x1877722797243008:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 Request processed in 143us (1651us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736280.270843:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 137 00000100:00100000:0.0:1790736280.278427:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736280.278527:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797243136 00000100:00100000:3.0:1790736280.278539:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797243136 00000100:00100000:3.0:1790736280.278615:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 9 00000100:00100000:3.0:1790736280.278626:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+17:2355:x1877722797243136:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790736280.278644:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790736280.278672:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6b58 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f77 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736280.278692:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94160678a900) 00010000:00010000:3.0:1790736280.278697:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790736280.278758:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+16:2355:x1877722797243136:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 133us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736280.278765:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 9 00000001:00080000:3.0:1790736280.284988:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1790736280.285124:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1790736280.285172:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1790736280.285181:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000040:00080000:2.0:1790736280.341573:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790736280.341591:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790736280.341626:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1790736280.341633:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1790736280.341778:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736281.366237:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790736282.163766:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736282.163806:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797243264 00000100:00100000:2.0:1790736282.163817:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797243264 00000100:00100000:2.0:1790736282.163895:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 138 00000100:00100000:2.0:1790736282.163906:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94150133dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+15:11305:x1877722797243264:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1790736282.163927:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736282.163950:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527a00/0x6aae200528fe6b66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526f7e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.164016:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6b6d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.164032:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6b6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.164044:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6b6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.164061:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6b74 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.164068:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6b74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.164075:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6b74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.164298:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6b6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.164308:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6b6d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.164314:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6b6d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.164334:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163c526800 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736282.164338:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6b6d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.164346:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6b6d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.164358:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94160678ac00) 00010000:00010000:2.0:1790736282.164361:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790736282.164366:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6b6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.164373:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6b6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.164385:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6b74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.164392:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6b74 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.164397:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6b74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.164402:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163c526600 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736282.164405:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6b74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.164411:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6b74 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.167936:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff94160678a600) 00010000:00010000:2.0:1790736282.167947:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790736282.167956:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6b74 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.167968:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6b74 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.168027:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527a00/0x6aae200528fe6b66 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f7e expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.168039:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94160678ac00) 00010000:00010000:2.0:1790736282.168042:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790736282.168046:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527a00/0x6aae200528fe6b66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f7e expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.168054:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94163c527a00, rc 0) 00000100:00100000:2.0:1790736282.168147:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94150133dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+15:11305:x1877722797243264:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 4243us (4390us total) trans 0 rc 301/301 00000100:00100000:2.0:1790736282.168156:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 138 00000100:00080000:2.0:1790736282.168201:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790736282.182589:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736282.187441:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797243520 00000100:00100000:1.0:1790736282.187456:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797243520 00000100:00100000:1.0:1790736282.187525:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 139 00000100:00100000:1.0:1790736282.187536:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94150133ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+15:11305:x1877722797243520:12345-192.168.203.5@tcp:36:lfs.0 00010000:00010000:1.0:1790736282.187659:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736282.187685:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931e00/0x6aae200528fe64f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526dbe expref: 15 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.187701:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94160678ac00) 00010000:00010000:1.0:1790736282.187713:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790736282.187934:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6b7b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.187947:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6b7b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.187955:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6b7b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.187966:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6b82 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.187973:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6b82 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.187978:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6b82 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790736282.193821:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1790736282.193842:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6b7b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.193852:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6b7b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.193860:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6b7b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.193870:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60a00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736282.193875:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6b7b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.193882:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6b7b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.193897:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff941603253f00) 00010000:00010000:1.0:1790736282.193900:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736282.193905:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6b7b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.193912:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6b7b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790736282.193931:0:5845:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005f260dd6 reply state 0000000080098980 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6b82 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736282.193940:0:5845:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790736282.194044:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94150133ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+16:11305:x1877722797243520:12345-192.168.203.5@tcp:36:lfs.0 Request processed in 6507us (11461us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1790736282.194053:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 139 00010000:00010000:2.0:1790736282.211333:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6b82 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.211352:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6b82 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.211360:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6b82 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.211375:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60800 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736282.211381:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6b82 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.211389:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6b82 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.211410:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff941603253300) 00010000:00010000:2.0:1790736282.211414:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790736282.211419:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6b82 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.212275:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6b82 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736282.310901:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736282.311292:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797243648 00000100:00100000:0.0:1790736282.311303:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797243648 00000100:00100000:0.0:1790736282.311357:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 140 00000100:00100000:0.0:1790736282.311367:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94150133df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+15:11313:x1877722797243648:12345-192.168.203.5@tcp:101:lctl.0 00010000:00010000:0.0:1790736282.311392:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736282.311417:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff400/0x6aae200528fe6b89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526f85 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736282.311494:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff600/0x6aae200528fe6b90 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736282.311508:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff600/0x6aae200528fe6b90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736282.311519:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff600/0x6aae200528fe6b90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790736282.311570:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790736282.311574:0:5843:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790736282.311598:0:5843:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff600/0x6aae200528fe6b90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736282.311623:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff400/0x6aae200528fe6b89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f85 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736282.311641:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff600/0x6aae200528fe6b90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f85 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736282.311667:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff941605242d00) 00010000:00010000:0.0:1790736282.311669:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790736282.311672:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9416013ff600, rc 0) 00000100:00100000:0.0:1790736282.311739:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94150133df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+16:11313:x1877722797243648:12345-192.168.203.5@tcp:101:lctl.0 Request processed in 373us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736282.311747:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 140 00010000:00010000:3.0:1790736282.389359:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736282.396569:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736282.396673:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797243776 00000100:00100000:3.0:1790736282.396682:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797243776 00000100:00100000:3.0:1790736282.396739:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 141 00000100:00100000:3.0:1790736282.396750:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+16:11319:x1877722797243776:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:3.0:1790736282.396771:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736282.396793:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe6b97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526f8c expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.396878:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6b9e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.397063:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6b9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.397073:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6b9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.397116:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6ba5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.397125:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.397132:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.397227:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6bac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.397236:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6bac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.397242:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6bac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790736282.397272:0:8114:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1790736282.397276:0:8114:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790736282.397297:0:8114:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6bac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.397323:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6b9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.397330:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6b9e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.397338:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6b9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.397344:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c9c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736282.397349:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6b9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.397356:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6b9e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.397367:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff941605242d00) 00010000:00010000:3.0:1790736282.397370:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736282.397374:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6b9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.397380:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6b9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.397393:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.397400:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6ba5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.397405:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6ba5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.397416:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c8000 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736282.397419:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6ba5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.397436:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6ba5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.397445:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff94161505d900) 00010000:00010000:3.0:1790736282.397447:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736282.397450:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6ba5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.397456:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6ba5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.397493:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe6b97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f8c expref: 18 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.397507:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6bac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f8c expref: 17 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.397515:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94161505de00) 00010000:00010000:3.0:1790736282.397518:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790736282.397520:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c9a00, rc 0) 00000100:00100000:3.0:1790736282.397646:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+17:11319:x1877722797243776:12345-192.168.203.5@tcp:101:bash.0 Request processed in 898us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736282.397655:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 141 00000100:00100000:3.0:1790736282.406677:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736282.406779:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797244032 00000100:00100000:0.0:1790736282.406791:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797244032 00000100:00100000:0.0:1790736282.406858:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 142 00000100:00100000:0.0:1790736282.406868:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+17:11319:x1877722797244032:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:0.0:1790736282.406889:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736282.406912:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff400/0x6aae200528fe6bb3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526f93 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736282.407036:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff800/0x6aae200528fe6bba lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736282.407052:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff800/0x6aae200528fe6bba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736282.407063:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff800/0x6aae200528fe6bba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736282.407076:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ffc00/0x6aae200528fe6bc1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736282.407082:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ffc00/0x6aae200528fe6bc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736282.407121:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ffc00/0x6aae200528fe6bc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790736282.407682:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1790736282.407850:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe400/0x6aae200528fe6bc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736282.407861:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe400/0x6aae200528fe6bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736282.407868:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe400/0x6aae200528fe6bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736282.407901:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff800/0x6aae200528fe6bba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736282.407909:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff800/0x6aae200528fe6bba lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736282.407915:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff800/0x6aae200528fe6bba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736282.407921:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9416013ff800 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736282.407925:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff800/0x6aae200528fe6bba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736282.407932:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff800/0x6aae200528fe6bba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736282.407943:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94161505de00) 00010000:00010000:0.0:1790736282.407946:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736282.407957:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff800/0x6aae200528fe6bba lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736282.407964:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff800/0x6aae200528fe6bba lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790736282.407978:0:5843:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000061d30ab1 reply state 0000000077b2735f transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ffc00/0x6aae200528fe6bc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736282.407986:0:5843:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790736282.408017:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff400/0x6aae200528fe6bb3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f93 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736282.408032:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe400/0x6aae200528fe6bc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f93 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736282.408040:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff941605242700) 00010000:00010000:0.0:1790736282.408043:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790736282.408045:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9416013fe400, rc 0) 00000100:00100000:0.0:1790736282.408297:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+20:11319:x1877722797244032:12345-192.168.203.5@tcp:101:bash.0 Request processed in 1429us (1630us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1790736282.408305:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 142 00010000:00010000:1.0:1790736282.410752:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ffc00/0x6aae200528fe6bc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.410770:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ffc00/0x6aae200528fe6bc1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.410779:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ffc00/0x6aae200528fe6bc1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.410803:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9416013ffc00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736282.410807:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ffc00/0x6aae200528fe6bc1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.410815:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ffc00/0x6aae200528fe6bc1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.410831:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff941605242500) 00010000:00010000:1.0:1790736282.410833:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736282.410838:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ffc00/0x6aae200528fe6bc1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.410846:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ffc00/0x6aae200528fe6bc1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736282.415768:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736282.418696:0:8632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797244160 00000100:00100000:1.0:1790736282.418712:0:8632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797244160 00000100:00100000:1.0:1790736282.418848:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 47 00000100:00100000:1.0:1790736282.418859:0:8632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2355:x1877722797244160:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:1.0:1790736282.418877:0:8632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736282.418897:0:8632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000193ba413/0x6aae200528fe6bd6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526f9a expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790736282.418925:0:8632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790736282.418944:0:8632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=354s v=(0 0) 00010000:00010000:1.0:1790736282.418949:0:8632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790736282.418958:0:8632:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000193ba413/0x6aae200528fe6bd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f9a expref: 6 pid: 8632 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.418999:0:8632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000193ba413/0x6aae200528fe6bd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f9a expref: 6 pid: 8632 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.419014:0:8632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c60e00, rc 0) 00000100:00100000:1.0:1790736282.419085:0:8632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2355:x1877722797244160:12345-192.168.203.5@tcp:101:bash.0 Request processed in 228us (3326us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736282.419111:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 47 00000100:00080000:2.0:1790736282.422544:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790736282.431323:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736282.431468:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797244288 00000100:00100000:2.0:1790736282.431479:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797244288 00000100:00100000:2.0:1790736282.431532:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 48 00000100:00100000:2.0:1790736282.431543:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+6:11319:x1877722797244288:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:2.0:1790736282.431561:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736282.431579:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7f3bfd5/0x6aae200528fe6bdd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526fa1 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.431726:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000193ba413/0x6aae200528fe6bd6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f9a expref: 7 pid: 8632 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.431754:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790736282.431758:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790736282.431763:0:6698:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7f3bfd5/0x6aae200528fe6bdd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526fa1 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.431796:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000193ba413/0x6aae200528fe6bd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f9a expref: 7 pid: 8632 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.431808:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000193ba413/0x6aae200528fe6bd6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f9a expref: 7 pid: 8632 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736282.431820:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94150133d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6698:1877722816127104:192.168.203.5@tcp:104: 00000100:00100000:2.0:1790736282.431919:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff94161871a540 going to sleep for 11 seconds 00000100:00100000:0.0:1790736282.441469:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736282.442236:0:8527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797244416 00000100:00100000:1.0:1790736282.442250:0:8527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797244416 00000100:00100000:2.0:1790736282.442269:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94150133d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6698:1877722816127104:192.168.203.5@tcp:104: 00010000:00010000:2.0:1790736282.442304:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c7f3bfd5/0x6aae200528fe6bdd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0x92962417a526fa1 expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.442305:0:8527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000193ba413/0x6aae200528fe6bd6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f9a expref: 8 pid: 8632 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.442330:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94163c527a00, rc 0) 00000100:00100000:1.0:1790736282.442351:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 61 00000100:00100000:1.0:1790736282.442360:0:8527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cfb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+8:2356:x1877722797244416:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790736282.442375:0:8527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736282.442400:0:8527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000193ba413/0x6aae200528fe6bd6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f9a expref: 8 pid: 8632 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.442412:0:8527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000193ba413/0x6aae200528fe6bd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f9a expref: 8 pid: 8632 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.442443:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000193ba413/0x6aae200528fe6bd6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f9a expref: 8 pid: 8632 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.442479:0:8527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790736282.442483:0:8527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790736282.442493:0:8527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7f3bfd5/0x6aae200528fe6bdd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0x92962417a526fa1 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.442504:0:8527:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7f3bfd5/0x6aae200528fe6bdd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0x92962417a526fa1 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736282.442519:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+7:11319:x1877722797244288:12345-192.168.203.5@tcp:101:bash.0 Request processed in 10921us (11147us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736282.442526:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 48 00010000:00010000:1.0:1790736282.442542:0:8527:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c7f3bfd5/0x6aae200528fe6bdd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0x92962417a526fa1 expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736282.442557:0:8527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f7ced80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8527:1877722816127232:192.168.203.5@tcp:105: 00000100:00100000:1.0:1790736282.442618:0:8527:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607c03600 going to sleep for 11 seconds 00000100:00100000:3.0:1790736282.458050:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736282.459139:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797244672 00000100:00100000:1.0:1790736282.459151:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797244672 00000100:00100000:1.0:1790736282.459210:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 36 00000100:00100000:1.0:1790736282.459221:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+19:11319:x1877722797244672:12345-192.168.203.5@tcp:35:bash.0 00000100:00100000:1.0:1790736282.459657:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+20:11319:x1877722797244672:12345-192.168.203.5@tcp:35:bash.0 Request processed in 435us (1617us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1790736282.459665:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 36 00000100:00100000:1.0:1790736282.467965:0:8527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f7ced80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8527:1877722816127232:192.168.203.5@tcp:105: 00010000:00010000:1.0:1790736282.467994:0:8527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790736282.468072:0:8527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cfb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2356:x1877722797244416:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 25712us (26612us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736282.468137:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 61 00000100:00100000:3.0:1790736282.566724:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736282.566836:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797244928 00000100:00100000:1.0:1790736282.566847:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797244928 00000100:00100000:1.0:1790736282.566906:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 143 00000100:00100000:1.0:1790736282.566916:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+20:11329:x1877722797244928:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1790736282.566954:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736282.566976:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6be4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526fa8 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790736282.567070:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1790736282.567250:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6be4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526fa8 expref: 22 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.567266:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff941605242d00) 00010000:00010000:1.0:1790736282.567287:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790736282.567292:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6be4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526fa8 expref: 22 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.567307:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c60e00, rc 0) 00000100:00100000:1.0:1790736282.567362:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+21:11329:x1877722797244928:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 447us (648us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1790736282.567370:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 143 00000100:00100000:2.0:1790736282.572254:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736282.572568:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797245184 00000100:00100000:0.0:1790736282.572579:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797245184 00000100:00100000:0.0:1790736282.572643:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 37 00000100:00100000:0.0:1790736282.572655:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94150133d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+21:11329:x1877722797245184:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:0.0:1790736282.572949:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94150133d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+22:11329:x1877722797245184:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 294us (702us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1790736282.572977:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 37 00000100:00100000:0.0:1790736282.686594:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736282.686742:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797245312 00000100:00100000:1.0:1790736282.686752:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797245312 00000100:00100000:1.0:1790736282.686807:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 144 00000100:00100000:1.0:1790736282.686825:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+22:11335:x1877722797245312:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1790736282.686865:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736282.686886:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6bf2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526faf expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.686945:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6bf9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.686959:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.686970:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790736282.687003:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1790736282.687006:0:5844:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790736282.687022:0:5844:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.687044:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6bf2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526faf expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.687061:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6bf9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526faf expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.687069:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94161505de00) 00010000:00010000:1.0:1790736282.687083:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790736282.687086:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c60600, rc 0) 00000100:00100000:1.0:1790736282.687193:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+23:11335:x1877722797245312:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 377us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736282.687200:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 144 00000100:00100000:3.0:1790736282.698307:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736282.698657:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797245568 00000100:00100000:1.0:1790736282.698667:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797245568 00000100:00100000:1.0:1790736282.698725:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 145 00000100:00100000:1.0:1790736282.698735:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+23:11335:x1877722797245568:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1790736282.698759:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736282.698782:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6c00 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526fb6 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.698900:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6c07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.698916:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6c07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.698926:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6c07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790736282.698936:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1790736282.699060:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6c00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526fb6 expref: 26 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.699078:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6c07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526fb6 expref: 25 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.699087:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff941605242700) 00010000:00010000:1.0:1790736282.699090:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790736282.699142:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c60400, rc 0) 00000100:00100000:1.0:1790736282.699206:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+25:11335:x1877722797245568:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 472us (907us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1790736282.699231:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 145 00000100:00100000:3.0:1790736282.705010:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736282.705133:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797245824 00000100:00100000:1.0:1790736282.705145:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797245824 00000100:00100000:1.0:1790736282.705214:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 146 00000100:00100000:1.0:1790736282.705225:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+25:11335:x1877722797245824:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1790736282.705269:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736282.705302:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6c15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526fbd expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.705405:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6c1c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.705420:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6c1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.705447:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6c1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790736282.705460:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1790736282.705598:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6c15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526fbd expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.705615:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6c1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526fbd expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.705623:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff941605242700) 00010000:00010000:1.0:1790736282.705626:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790736282.705629:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c60a00, rc 0) 00000100:00100000:1.0:1790736282.705708:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+27:11335:x1877722797245824:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 485us (708us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1790736282.705715:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 146 00000100:00100000:0.0:1790736282.714316:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736282.714414:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797245952 00000100:00100000:3.0:1790736282.714435:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797245952 00000100:00100000:3.0:1790736282.714516:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 10 00000100:00100000:3.0:1790736282.714527:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+27:2356:x1877722797245952:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790736282.714545:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790736282.714573:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6c07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526fb6 expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.714592:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff941605242700) 00010000:00010000:3.0:1790736282.714597:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790736282.714658:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+26:2356:x1877722797245952:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 132us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736282.714665:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 10 00000100:00100000:3.0:1790736282.716083:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736282.716193:0:8632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797246080 00000100:00100000:1.0:1790736282.716202:0:8632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797246080 00000100:00100000:1.0:1790736282.716253:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 49 00000100:00100000:1.0:1790736282.716264:0:8632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2354:x1877722797246080:12345-192.168.203.5@tcp:1:lfs.0 00010000:00010000:1.0:1790736282.716314:0:8632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000193ba413/0x6aae200528fe6c2a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.716335:0:8632:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7f3bfd5/0x6aae200528fe6bdd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0x92962417a526fa1 expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.716343:0:8632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790736282.716348:0:8632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790736282.716352:0:8632:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000193ba413/0x6aae200528fe6c2a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.716388:0:8632:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c7f3bfd5/0x6aae200528fe6bdd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.5@tcp remote: 0x92962417a526fa1 expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.716403:0:8632:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c7f3bfd5/0x6aae200528fe6bdd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a526fa1 expref: 6 pid: 6698 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736282.716416:0:8632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f7ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8632:1877722816127360:192.168.203.5@tcp:104: 00000100:00100000:1.0:1790736282.716522:0:8632:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607c03a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790736282.723179:0:8632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f7ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8632:1877722816127360:192.168.203.5@tcp:104: 00010000:00010000:1.0:1790736282.723215:0:8632:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000193ba413/0x6aae200528fe6c2a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736282.727692:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736282.727878:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797246208 00000100:00100000:2.0:1790736282.727889:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797246208 00002000:00100000:2.0:1790736282.727973:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff94163b6f5f80 x1877722797246208/t0(0) o4->f945944d-9086-46a2-a91c-8bc7b88e8918@192.168.203.5@tcp:113/0 lens 504/0 e 0 to 0 dl 1790736293 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790736282.727984:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94163b6f5f80 with x1877722797246208 ext(0->12) 00010000:00010000:2.0:1790736282.727997:0:6705:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c7f3bfd5/0x6aae200528fe6bdd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a526fa1 expref: 7 pid: 6698 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.728018:0:6705:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c7f3bfd5/0x6aae200528fe6bdd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a526fa1 expref: 7 pid: 6698 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790736282.728027:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff94163b6f5f80 00000100:00100000:2.0:1790736282.728137:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2 00000100:00100000:2.0:1790736282.728147:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+7:2356:x1877722797246208:12345-192.168.203.5@tcp:4:lfs.0 00000100:00100000:2.0:1790736282.730736:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+9:2356:x1877722797246208:12345-192.168.203.5@tcp:4:lfs.0 Request processed in 2581us (3046us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1790736282.730748:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2 00002000:00100000:2.0:1790736282.730759:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff94163b6f5f80 x1877722797246208/t4294967305(0) o4->f945944d-9086-46a2-a91c-8bc7b88e8918@192.168.203.5@tcp:113/0 lens 504/448 e 0 to 0 dl 1790736293 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790736282.730769:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94163b6f5f80 with x1877722797246208 ext(0->12) 00010000:00010000:2.0:1790736282.730779:0:6705:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c7f3bfd5/0x6aae200528fe6bdd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a526fa1 expref: 9 pid: 6698 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.730795:0:6705:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c7f3bfd5/0x6aae200528fe6bdd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a526fa1 expref: 9 pid: 6698 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790736282.730803:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff94163b6f5f80 00000100:00100000:2.0:1790736282.733698:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736282.733790:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797246336 00000100:00100000:0.0:1790736282.733799:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797246336 00010000:00010000:0.0:1790736282.733837:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c7f3bfd5/0x6aae200528fe6bdd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a526fa1 expref: 9 pid: 6698 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736282.733923:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 62 00000100:00100000:0.0:1790736282.733932:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94150133c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+9:2355:x1877722797246336:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790736282.733948:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1790736282.733966:0:5828:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1790736282.733969:0:5828:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1790736282 00002000:00010000:0.0:1790736282.733971:0:5828:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1790736283 00002000:00010000:0.0:1790736282.733973:0:5828:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1790736282 00010000:00010000:0.0:1790736282.733979:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c7f3bfd5/0x6aae200528fe6bdd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a526fa1 expref: 9 pid: 6698 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736282.733994:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c7f3bfd5/0x6aae200528fe6bdd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a526fa1 expref: 9 pid: 6698 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736282.734017:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7f3bfd5/0x6aae200528fe6bdd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.5@tcp remote: 0x92962417a526fa1 expref: 9 pid: 6698 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736282.734035:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790736282.734039:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790736282.734062:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000193ba413/0x6aae200528fe6c2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736282.734073:0:5828:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000193ba413/0x6aae200528fe6c2a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736282.734173:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790736282.734224:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94150133c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+8:2355:x1877722797246336:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 293us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736282.734232:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 62 00010000:00010000:3.0:1790736282.734409:0:8632:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000193ba413/0x6aae200528fe6c2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.734420:0:8632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000193ba413/0x6aae200528fe6c2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.734474:0:8632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000193ba413/0x6aae200528fe6c2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.734483:0:8632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000193ba413/0x6aae200528fe6c2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.734491:0:8632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000193ba413/0x6aae200528fe6c2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.734498:0:8632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60e00 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:3.0:1790736282.734502:0:8632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000193ba413/0x6aae200528fe6c2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.734511:0:8632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000193ba413/0x6aae200528fe6c2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.734522:0:8632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000193ba413/0x6aae200528fe6c2a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.734529:0:8632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000193ba413/0x6aae200528fe6c2a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736282.734574:0:8632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+7:2354:x1877722797246080:12345-192.168.203.5@tcp:1:lfs.0 Request processed in 18313us (18498us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736282.734581:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 49 00000100:00100000:2.0:1790736282.737385:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736282.737525:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797246592 00000100:00100000:1.0:1790736282.737538:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797246592 00000100:00100000:1.0:1790736282.737602:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 38 00000100:00100000:1.0:1790736282.737613:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416114eec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+26:11335:x1877722797246592:12345-192.168.203.5@tcp:35:lfs.0 00000004:00010000:1.0:1790736282.737675:0:5847:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6c1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526fbd expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790736282.737937:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1790736282.737979:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1790736282.738577:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1790736282.738632:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6c31 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.738650:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe400/0x6aae200528fe6bc8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f93 expref: 30 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.738658:0:5847:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6c31 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.738690:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe400/0x6aae200528fe6bc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f93 expref: 30 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.738705:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe400/0x6aae200528fe6bc8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f93 expref: 30 pid: 5843 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736282.738733:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f7ced80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5847:1877722816127488:192.168.203.5@tcp:104: 00000100:00100000:1.0:1790736282.738820:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607c03600 going to sleep for 11 seconds 00000100:00100000:3.0:1790736282.743046:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736282.743137:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797246720 00000100:00100000:0.0:1790736282.743146:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797246720 00010000:00010000:0.0:1790736282.743179:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe400/0x6aae200528fe6bc8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f93 expref: 31 pid: 5843 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736282.743210:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 63 00000100:00100000:0.0:1790736282.743218:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+31:2355:x1877722797246720:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790736282.743232:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790736282.743238:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe400/0x6aae200528fe6bc8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f93 expref: 31 pid: 5843 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736282.743250:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe400/0x6aae200528fe6bc8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f93 expref: 31 pid: 5843 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736282.743269:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff941605242700) 00010000:00010000:0.0:1790736282.743274:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6c31 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736282.743308:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6c31 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736282.743315:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6c31 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736282.743348:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790736282.743725:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+31:2355:x1877722797246720:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 506us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736282.743734:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 63 00010000:00010000:1.0:1790736282.743827:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe400/0x6aae200528fe6bc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526f93 expref: 30 pid: 5843 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736282.743844:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f7ced80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5847:1877722816127488:192.168.203.5@tcp:104: 00010000:00010000:1.0:1790736282.743868:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6c31 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.743876:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6c31 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736282.743881:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6c31 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790736282.743997:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1790736282.744222:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1790736282.744334:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f7ced80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1877722816127616:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790736282.744450:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736282.744478:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607c03cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790736282.744843:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816127616 00000100:00100000:3.0:1790736282.744851:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816127616 00000100:00100000:3.0:1790736282.744916:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790736282.744926:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642040700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5847:x1877722816127616:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790736282.745000:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642040700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5847:x1877722816127616:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 75us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736282.745007:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1790736282.745360:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790736282.745755:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f7ced80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1877722816127616:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1790736282.746765:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1790736282.746852:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941642041180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1877722816127744:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790736282.746911:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736282.746988:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607c03600 going to sleep for 11 seconds 00000100:00100000:3.0:1790736282.747034:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816127744 00000100:00100000:3.0:1790736282.747042:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816127744 00000100:00100000:3.0:1790736282.747190:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790736282.747200:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5847:x1877722816127744:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790736282.747420:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5847:x1877722816127744:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 221us (508us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1790736282.747448:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790736282.748811:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941642041180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1877722816127744:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1790736282.748904:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1790736282.748968:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6c31 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.748978:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6c31 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.748986:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6c31 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.748991:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60800 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736282.748995:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6c31 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.749002:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6c31 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.749017:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff941605242700) 00010000:00010000:2.0:1790736282.749019:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1790736282.749025:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6c31 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.749031:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6c31 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790736282.751781:0:5847:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1790736282.751946:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1790736282.751962:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 354762867152ns, next at 355762863450ns, rc = 0 00000001:00080000:2.0:1790736282.751987:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1790736282.752049:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff941605242700) 00010000:00010000:2.0:1790736282.752054:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790736282.752065:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6c1c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526fbd expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736282.753677:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416114eec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+33:11335:x1877722797246592:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 16058us (16291us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1790736282.753690:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 38 00000020:00080000:2.0:1790736282.753698:0:5847:0:(tgt_main.c:787:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1790736282.756932:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736282.757054:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797246848 00000100:00100000:2.0:1790736282.757065:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797246848 00000100:00100000:2.0:1790736282.757149:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 147 00000100:00100000:2.0:1790736282.757160:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+33:11335:x1877722797246848:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1790736282.757188:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736282.757213:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526200/0x6aae200528fe6c38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526fc4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.757272:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526200/0x6aae200528fe6c38 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526fc4 expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.757297:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526200/0x6aae200528fe6c38 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526fc4 expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.757318:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94160678a600) 00010000:00010000:2.0:1790736282.757321:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790736282.757325:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94163c526200, rc 0) 00000100:00100000:2.0:1790736282.758464:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+34:11335:x1877722797246848:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1299us (1535us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736282.758489:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 147 00000100:00100000:3.0:1790736282.764454:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736282.764661:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797247104 00000100:00100000:2.0:1790736282.764671:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797247104 00000100:00100000:2.0:1790736282.764724:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 39 00000100:00100000:2.0:1790736282.764734:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+34:11335:x1877722797247104:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:2.0:1790736282.764949:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+35:11335:x1877722797247104:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 216us (502us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1790736282.764957:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 39 00000100:00100000:1.0:1790736282.861816:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736282.861932:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797247360 00000100:00100000:2.0:1790736282.861942:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797247360 00000100:00100000:2.0:1790736282.862003:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 148 00000100:00100000:2.0:1790736282.862014:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+35:11345:x1877722797247360:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1790736282.862044:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736282.862070:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527600/0x6aae200528fe6c3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526fcb expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790736282.862193:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1790736282.862318:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527600/0x6aae200528fe6c3f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526fcb expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.862331:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff941605242d00) 00010000:00010000:2.0:1790736282.862334:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790736282.862339:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527600/0x6aae200528fe6c3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526fcb expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.862352:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94163c527600, rc 0) 00000100:00100000:2.0:1790736282.862415:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+36:11345:x1877722797247360:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 403us (611us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1790736282.862431:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 148 00000100:00100000:0.0:1790736282.866825:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736282.866924:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797247488 00000100:00100000:3.0:1790736282.866934:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797247488 00000100:00100000:3.0:1790736282.867021:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 149 00000100:00100000:3.0:1790736282.867032:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c5e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+36:11345:x1877722797247488:12345-192.168.203.5@tcp:34:lfs.0 00010000:00010000:3.0:1790736282.867184:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6c4d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.867201:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6c4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.867213:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6c4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.867239:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe6c54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.867246:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe6c54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.867253:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe6c54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.867462:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6c5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.867471:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6c5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.867479:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6c5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790736282.867523:0:8114:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6c5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.867534:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6c4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.867541:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6c4d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.867549:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6c4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.867554:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c8e00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736282.867558:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6c4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.867571:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6c4d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.867582:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94161505de00) 00010000:00010000:3.0:1790736282.867585:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736282.867589:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6c4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.867595:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6c4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.867606:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe6c54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.867611:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe6c54 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.867616:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe6c54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.867620:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c9800 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736282.867623:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe6c54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.867628:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe6c54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.867633:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94161505d900) 00010000:00010000:3.0:1790736282.867635:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736282.867637:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe6c54 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.867650:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe6c54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.867663:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6c5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.867668:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6c5b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.867673:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6c5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.867678:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c8000 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736282.867680:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6c5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.867685:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6c5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.867691:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94160678a600) 00010000:00010000:3.0:1790736282.867692:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736282.867695:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6c5b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736282.867699:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6c5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736282.867821:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c5e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+36:11345:x1877722797247488:12345-192.168.203.5@tcp:34:lfs.0 Request processed in 789us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736282.867828:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 149 00000100:00100000:2.0:1790736282.875258:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736282.875540:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797247744 00000100:00100000:1.0:1790736282.875550:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797247744 00000100:00100000:1.0:1790736282.875606:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 40 00000100:00100000:1.0:1790736282.875616:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94150133fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+36:11345:x1877722797247744:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:1.0:1790736282.875880:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94150133fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+37:11345:x1877722797247744:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 265us (631us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1790736282.875888:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 40 00000100:00100000:1.0:1790736282.919784:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736282.919968:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797248000 00000100:00100000:2.0:1790736282.919981:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797248000 00000100:00100000:2.0:1790736282.920056:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 150 00000100:00100000:2.0:1790736282.920067:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+37:11348:x1877722797248000:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1790736282.920118:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736282.920146:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527600/0x6aae200528fe6c62 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526fd2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.920237:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527400/0x6aae200528fe6c69 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.920257:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527400/0x6aae200528fe6c69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.920270:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527400/0x6aae200528fe6c69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.920303:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527000/0x6aae200528fe6c70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.920311:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527000/0x6aae200528fe6c70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.920318:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527000/0x6aae200528fe6c70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.920674:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527800/0x6aae200528fe6c77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.920701:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527800/0x6aae200528fe6c77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.920709:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527800/0x6aae200528fe6c77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790736282.920720:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1790736282.920850:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527400/0x6aae200528fe6c69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.920858:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527400/0x6aae200528fe6c69 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.920865:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527400/0x6aae200528fe6c69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.920871:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163c527400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736282.920875:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527400/0x6aae200528fe6c69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.920883:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527400/0x6aae200528fe6c69 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.920897:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94161505de00) 00010000:00010000:2.0:1790736282.920900:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790736282.920906:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527400/0x6aae200528fe6c69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.920912:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527400/0x6aae200528fe6c69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.920927:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527000/0x6aae200528fe6c70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.920940:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527000/0x6aae200528fe6c70 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.920946:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527000/0x6aae200528fe6c70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.920951:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163c527000 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736282.920954:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527000/0x6aae200528fe6c70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.920960:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527000/0x6aae200528fe6c70 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.920968:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94160678aa00) 00010000:00010000:2.0:1790736282.920971:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790736282.920974:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527000/0x6aae200528fe6c70 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.920979:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527000/0x6aae200528fe6c70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.921037:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527600/0x6aae200528fe6c62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526fd2 expref: 40 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.921051:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527800/0x6aae200528fe6c77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526fd2 expref: 39 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.921058:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94160678a600) 00010000:00010000:2.0:1790736282.921061:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790736282.921069:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94163c527800, rc 0) 00000100:00100000:2.0:1790736282.921326:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+39:11348:x1877722797248000:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1260us (1552us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1790736282.921335:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 150 00000100:00100000:0.0:1790736282.926399:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736282.926635:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797248128 00000100:00100000:2.0:1790736282.926648:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797248128 00000100:00100000:2.0:1790736282.926757:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 151 00000100:00100000:2.0:1790736282.926768:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+39:11348:x1877722797248128:12345-192.168.203.5@tcp:54:lfs.0 00010000:00010000:2.0:1790736282.926844:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527600/0x6aae200528fe6c85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.926862:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527600/0x6aae200528fe6c85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.926870:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527600/0x6aae200528fe6c85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.926895:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527600/0x6aae200528fe6c85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.926900:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527600/0x6aae200528fe6c85 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.926904:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527600/0x6aae200528fe6c85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.926908:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163c527600 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736282.926912:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527600/0x6aae200528fe6c85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.926916:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527600/0x6aae200528fe6c85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.926940:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94160678a600) 00010000:00010000:2.0:1790736282.926942:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790736282.926947:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527600/0x6aae200528fe6c85 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736282.926952:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527600/0x6aae200528fe6c85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736282.927027:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+39:11348:x1877722797248128:12345-192.168.203.5@tcp:54:lfs.0 Request processed in 262us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736282.927032:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 151 00000100:00100000:3.0:1790736282.929439:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736282.929628:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797248384 00000100:00100000:1.0:1790736282.929638:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797248384 00000100:00100000:1.0:1790736282.929694:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 41 00000100:00100000:1.0:1790736282.929704:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+39:11348:x1877722797248384:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:1.0:1790736282.929935:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+40:11348:x1877722797248384:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 232us (524us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1790736282.929942:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 41 00000100:00100000:1.0:1790736283.236390:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736283.237603:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797248640 00000100:00100000:0.0:1790736283.237617:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797248640 00000100:00100000:0.0:1790736283.237696:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 152 00000100:00100000:0.0:1790736283.237707:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+40:11379:x1877722797248640:12345-192.168.203.5@tcp:101:cat.0 00010000:00010000:0.0:1790736283.237735:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736283.237759:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff400/0x6aae200528fe6c8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526fd9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736283.237862:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe400/0x6aae200528fe6c93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736283.237877:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe400/0x6aae200528fe6c93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736283.237891:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe400/0x6aae200528fe6c93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790736283.237924:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1790736283.238064:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff400/0x6aae200528fe6c8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526fd9 expref: 43 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736283.238082:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe400/0x6aae200528fe6c93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526fd9 expref: 42 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736283.238150:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94160678a600) 00010000:00010000:0.0:1790736283.238154:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790736283.238158:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9416013fe400, rc 0) 00000100:00100000:0.0:1790736283.238225:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+42:11379:x1877722797248640:12345-192.168.203.5@tcp:101:cat.0 Request processed in 519us (1843us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1790736283.238232:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 152 00000100:00100000:0.0:1790736283.250939:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736283.250992:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736283.251085:0:8527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797249024 00000100:00100000:2.0:1790736283.251126:0:8527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797249024 00000100:00100000:2.0:1790736283.251196:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 11 00000100:00100000:2.0:1790736283.251206:0:8527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+42:2355:x1877722797249024:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790736283.251222:0:8527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790736283.251246:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe400/0x6aae200528fe6c93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526fd9 expref: 42 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736283.251277:0:8527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94160678a600) 00010000:00010000:2.0:1790736283.251282:0:8527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790736283.251341:0:8527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+41:2355:x1877722797249024:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 137us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736283.251350:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 11 00000100:00100000:1.0:1790736283.252131:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797248896 00000100:00100000:1.0:1790736283.252138:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797248896 00000100:00100000:1.0:1790736283.252175:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 42 00000100:00100000:1.0:1790736283.252183:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+41:11379:x1877722797248896:12345-192.168.203.5@tcp:35:cat.0 00000100:00100000:1.0:1790736283.252467:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+42:11379:x1877722797248896:12345-192.168.203.5@tcp:35:cat.0 Request processed in 284us (1536us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1790736283.252475:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 42 00000100:00100000:0.0:1790736283.307309:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736283.307395:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797249280 00000100:00100000:3.0:1790736283.307405:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797249280 00000100:00100000:3.0:1790736283.307481:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 153 00000100:00100000:3.0:1790736283.307491:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+42:11385:x1877722797249280:12345-192.168.203.5@tcp:101:dd.0 00010000:00010000:3.0:1790736283.307529:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736283.307534:0:8114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790736283.307563:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6bf9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526faf expref: 42 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736283.307583:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94161505de00) 00010000:00010000:3.0:1790736283.307589:0:8114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790736283.307602:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe6ca1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526fe0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736283.307707:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6ca8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736283.307721:0:8114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527800/0x6aae200528fe6c77 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526fd2 expref: 42 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736283.307729:0:8114:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6ca8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736283.307763:0:8114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527800/0x6aae200528fe6c77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0x92962417a526fd2 expref: 42 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736283.307777:0:8114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527800/0x6aae200528fe6c77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526fd2 expref: 42 pid: 5844 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736283.307823:0:8114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b6f4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8114:1877722816127872:192.168.203.5@tcp:104: 00000100:00100000:3.0:1790736283.307971:0:8114:0:(client.c:2716:ptlrpc_set_wait()) set ffff941612178240 going to sleep for 11 seconds 00000100:00100000:0.0:1790736283.311600:0:8114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b6f4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8114:1877722816127872:192.168.203.5@tcp:104: 00010000:00010000:0.0:1790736283.311630:0:8114:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6ca8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736283.313893:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736283.313964:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797249408 00000100:00100000:3.0:1790736283.313976:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797249408 00010000:00010000:3.0:1790736283.314023:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527800/0x6aae200528fe6c77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526fd2 expref: 43 pid: 5844 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736283.314070:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 64 00000100:00100000:3.0:1790736283.314080:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160557d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+43:2355:x1877722797249408:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790736283.314109:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790736283.314115:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527800/0x6aae200528fe6c77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526fd2 expref: 43 pid: 5844 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736283.314125:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527800/0x6aae200528fe6c77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526fd2 expref: 43 pid: 5844 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736283.314143:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527800/0x6aae200528fe6c77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526fd2 expref: 43 pid: 5844 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736283.314155:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94160678a600) 00010000:00010000:3.0:1790736283.314161:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6ca8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736283.314171:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6ca8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736283.314197:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6ca8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736283.314230:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790736283.314297:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160557d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+42:2355:x1877722797249408:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 218us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736283.314304:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 64 00010000:00010000:1.0:1790736283.314535:0:8114:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6ca8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.314544:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6ca8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790736283.314570:0:8114:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1790736283.314736:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe6ca1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526fe0 expref: 43 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.314751:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6ca8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526fe0 expref: 42 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.314758:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94160678a600) 00010000:00010000:1.0:1790736283.314761:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790736283.314763:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c8000, rc 0) 00000100:00100000:1.0:1790736283.314883:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+42:11385:x1877722797249280:12345-192.168.203.5@tcp:101:dd.0 Request processed in 7393us (7584us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1790736283.314890:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 153 00000100:00100000:0.0:1790736283.317548:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736283.317648:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797249664 00000100:00100000:2.0:1790736283.317658:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797249664 00000100:00100000:2.0:1790736283.317715:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 154 00000100:00100000:2.0:1790736283.317738:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+42:11385:x1877722797249664:12345-192.168.203.5@tcp:36:dd.0 00010000:00010000:2.0:1790736283.318011:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527000/0x6aae200528fe6cb6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736283.318030:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527000/0x6aae200528fe6cb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736283.318041:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527000/0x6aae200528fe6cb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790736283.318148:0:5843:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1790736283.318176:0:5843:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000055c2507a reply state 00000000e6549bf4 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527000/0x6aae200528fe6cb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736283.318184:0:5843:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790736283.318272:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+45:11385:x1877722797249664:12345-192.168.203.5@tcp:36:dd.0 Request processed in 535us (732us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1790736283.318280:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 154 00000020:00080000:2.0:1790736283.318285:0:5843:0:(tgt_main.c:787:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790736283.320746:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527000/0x6aae200528fe6cb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736283.320835:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527000/0x6aae200528fe6cb6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736283.320870:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527000/0x6aae200528fe6cb6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736283.320877:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163c527000 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736283.320882:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527000/0x6aae200528fe6cb6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736283.320890:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527000/0x6aae200528fe6cb6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736283.320905:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94160678a600) 00010000:00010000:0.0:1790736283.320909:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736283.320913:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527000/0x6aae200528fe6cb6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736283.320920:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527000/0x6aae200528fe6cb6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.413344:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790736283.633682:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736283.633785:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797249792 00000100:00100000:2.0:1790736283.633797:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797249792 00000100:00100000:2.0:1790736283.633863:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 155 00000100:00100000:2.0:1790736283.633872:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+44:11399:x1877722797249792:12345-192.168.203.5@tcp:101:stat.0 00010000:00010000:2.0:1790736283.633898:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736283.633924:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527400/0x6aae200528fe6cbd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526fe7 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736283.634008:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527a00/0x6aae200528fe6cc4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736283.634042:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527a00/0x6aae200528fe6cc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736283.634053:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527a00/0x6aae200528fe6cc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736283.634069:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526e00/0x6aae200528fe6ccb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736283.634076:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526e00/0x6aae200528fe6ccb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736283.634081:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526e00/0x6aae200528fe6ccb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736283.634211:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6cd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736283.634222:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6ca8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526fe0 expref: 45 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736283.634232:0:5845:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6cd2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736283.634269:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6ca8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0x92962417a526fe0 expref: 45 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736283.634281:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6ca8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526fe0 expref: 45 pid: 8114 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736283.634303:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94150133d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1877722816128000:192.168.203.5@tcp:104: 00000100:00100000:2.0:1790736283.634401:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff941621677a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790736283.640187:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736283.641817:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94150133d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1877722816128000:192.168.203.5@tcp:104: 00010000:00010000:2.0:1790736283.641846:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6cd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736283.645001:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797250048 00000100:00100000:1.0:1790736283.645018:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797250048 00000100:00100000:1.0:1790736283.645123:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 43 00000100:00100000:1.0:1790736283.645135:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+46:5593:x1877722797250048:12345-192.168.203.5@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790736283.645501:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+47:5593:x1877722797250048:12345-192.168.203.5@tcp:35:ldlm_bl.0 Request processed in 367us (5324us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1790736283.645509:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 43 00000100:00100000:3.0:1790736283.657343:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736283.659260:0:8527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797250176 00000100:00100000:2.0:1790736283.659287:0:8527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797250176 00010000:00010000:2.0:1790736283.659348:0:8527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6ca8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526fe0 expref: 47 pid: 8114 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736283.659397:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 65 00000100:00100000:2.0:1790736283.659408:0:8527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+47:2356:x1877722797250176:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790736283.659439:0:8527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790736283.659447:0:8527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6ca8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526fe0 expref: 47 pid: 8114 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736283.659864:0:8527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6ca8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526fe0 expref: 47 pid: 8114 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736283.659888:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6ca8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526fe0 expref: 47 pid: 8114 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736283.659907:0:8527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94160678a600) 00010000:00010000:2.0:1790736283.659912:0:8527:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6cd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736283.659940:0:8527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736283.659949:0:8527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6cd2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736283.659985:0:8527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790736283.660062:0:8527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+46:2356:x1877722797250176:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 656us (2727us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736283.660071:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 65 00010000:00010000:1.0:1790736283.660688:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.660698:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790736283.660765:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1790736283.660769:0:5845:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790736283.660795:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.660808:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.660818:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527a00/0x6aae200528fe6cc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.660824:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527a00/0x6aae200528fe6cc4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.660832:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527a00/0x6aae200528fe6cc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.660837:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163c527a00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736283.660841:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527a00/0x6aae200528fe6cc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.660848:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527a00/0x6aae200528fe6cc4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.660859:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94161505de00) 00010000:00010000:1.0:1790736283.660862:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736283.660867:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527a00/0x6aae200528fe6cc4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.660872:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527a00/0x6aae200528fe6cc4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.660895:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526e00/0x6aae200528fe6ccb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.660901:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526e00/0x6aae200528fe6ccb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.660906:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526e00/0x6aae200528fe6ccb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.660910:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163c526e00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736283.660913:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526e00/0x6aae200528fe6ccb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.660917:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526e00/0x6aae200528fe6ccb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.660924:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94160678aa00) 00010000:00010000:1.0:1790736283.660926:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736283.660928:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526e00/0x6aae200528fe6ccb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.660933:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526e00/0x6aae200528fe6ccb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.660973:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527400/0x6aae200528fe6cbd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526fe7 expref: 46 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.660985:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6cd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526fe7 expref: 45 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.661004:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94160678a600) 00010000:00010000:1.0:1790736283.661006:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790736283.661008:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94163c526800, rc 0) 00000100:00100000:1.0:1790736283.661047:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+45:11399:x1877722797249792:12345-192.168.203.5@tcp:101:stat.0 Request processed in 27177us (27377us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736283.661054:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 155 00000100:00100000:0.0:1790736283.735948:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736283.736110:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797250432 00000100:00100000:2.0:1790736283.736121:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797250432 00000100:00100000:2.0:1790736283.736186:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 156 00000100:00100000:2.0:1790736283.736197:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+45:11405:x1877722797250432:12345-192.168.203.5@tcp:36:truncate.0 00010000:00010000:2.0:1790736283.736259:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790736283.736287:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6cd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526fe7 expref: 45 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736283.736304:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94160678a600) 00010000:00010000:2.0:1790736283.736310:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790736283.736541:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6cd9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736283.736556:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6cd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736283.736565:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6cd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790736283.736635:0:5843:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1790736283.736671:0:5843:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000944a0cf0 reply state 000000000974e264 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6cd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736283.736681:0:5843:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790736283.736776:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+47:11405:x1877722797250432:12345-192.168.203.5@tcp:36:truncate.0 Request processed in 580us (839us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1790736283.736783:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 156 00000020:00080000:2.0:1790736283.736788:0:5843:0:(tgt_main.c:787:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790736283.741164:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6cd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.741188:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6cd9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.741195:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6cd9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.741202:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163c526600 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736283.741208:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6cd9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.741216:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6cd9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.741235:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94160678a600) 00010000:00010000:1.0:1790736283.741239:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736283.741245:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6cd9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.741252:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6cd9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736283.797631:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94150133d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816128128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790736283.797837:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736283.798241:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816128128 00000100:00100000:2.0:1790736283.798250:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816128128 00000100:00100000:2.0:1790736283.798313:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790736283.798391:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816128128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790736283.798509:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790736283.798904:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816128128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 515us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736283.799059:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94150133d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816128128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790736283.799164:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1790736283.799226:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790736283.917054:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736283.917218:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797250560 00000100:00100000:1.0:1790736283.917231:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797250560 00000100:00100000:1.0:1790736283.917302:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 157 00000100:00100000:1.0:1790736283.917390:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+46:11419:x1877722797250560:12345-192.168.203.5@tcp:101:stat.0 00010000:00010000:1.0:1790736283.917430:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736283.917452:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe6ce0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526fee expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.917520:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6ce7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.917539:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6ce7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.917550:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6ce7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.917565:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6cee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.917571:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6cee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.917578:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6cee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.919439:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6cf5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.919457:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.919483:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790736283.919524:0:8114:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1790736283.919528:0:8114:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790736283.919549:0:8114:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.919561:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.919570:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6ce7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.919576:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6ce7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.919583:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6ce7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.919590:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60600 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736283.919593:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6ce7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.919600:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6ce7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.919611:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94161505de00) 00010000:00010000:1.0:1790736283.919613:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736283.919629:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6ce7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.919653:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6ce7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.919676:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6cee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.919690:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6cee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.919697:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6cee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.919702:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c61800 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736283.919705:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6cee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.919711:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6cee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.919719:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff941603253900) 00010000:00010000:1.0:1790736283.919721:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736283.919724:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6cee lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.919730:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6cee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.919770:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe6ce0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526fee expref: 48 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.919784:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6cf5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526fee expref: 47 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736283.919798:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94160678a600) 00010000:00010000:1.0:1790736283.919800:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790736283.919803:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c61c00, rc 0) 00000100:00100000:1.0:1790736283.920424:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+47:11419:x1877722797250560:12345-192.168.203.5@tcp:101:stat.0 Request processed in 3099us (3792us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736283.920434:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 157 00000100:00100000:3.0:1790736284.026287:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736284.028384:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797250816 00000100:00100000:2.0:1790736284.028399:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797250816 00000100:00100000:2.0:1790736284.028599:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 158 00000100:00100000:2.0:1790736284.028612:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+47:11429:x1877722797250816:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1790736284.028645:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736284.028670:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6cfc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526ff5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790736284.028771:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1790736284.029225:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6cfc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526ff5 expref: 49 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736284.029255:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff941605242d00) 00010000:00010000:2.0:1790736284.029258:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790736284.029264:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6cfc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526ff5 expref: 49 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736284.029279:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94163c526800, rc 0) 00000100:00100000:2.0:1790736284.031275:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+48:11429:x1877722797250816:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 2651us (4985us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1790736284.031289:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 158 00000100:00080000:0.0:1790736284.032073:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790736284.039623:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736284.039791:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797251072 00000100:00100000:1.0:1790736284.039821:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797251072 00000100:00100000:1.0:1790736284.039898:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 44 00000100:00100000:1.0:1790736284.039908:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416114ee850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+48:11429:x1877722797251072:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:1.0:1790736284.040222:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416114ee850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+49:11429:x1877722797251072:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 314us (625us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1790736284.040230:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 44 00000100:00100000:3.0:1790736284.091732:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736284.091869:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797251328 00000100:00100000:2.0:1790736284.091883:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797251328 00000100:00100000:2.0:1790736284.091976:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 159 00000100:00100000:2.0:1790736284.091989:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+49:11435:x1877722797251328:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:2.0:1790736284.092024:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736284.092056:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6d0a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a526ffc expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736284.092293:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526000/0x6aae200528fe6d11 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736284.092312:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6cf5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526fee expref: 50 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736284.092323:0:5845:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526000/0x6aae200528fe6d11 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736284.092368:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6cf5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0x92962417a526fee expref: 50 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736284.092392:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6cf5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526fee expref: 50 pid: 8114 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736284.092411:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94150133f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1877722816128256:192.168.203.5@tcp:104: 00000100:00100000:2.0:1790736284.092549:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff941621677a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790736284.095979:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736284.096138:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797251456 00000100:00100000:0.0:1790736284.096151:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797251456 00010000:00010000:0.0:1790736284.096204:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6cf5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526fee expref: 51 pid: 8114 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736284.096279:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 66 00000100:00100000:0.0:1790736284.096289:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+51:2356:x1877722797251456:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790736284.096309:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790736284.096316:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6cf5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526fee expref: 51 pid: 8114 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736284.096330:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6cf5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526fee expref: 51 pid: 8114 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736284.096357:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94160678a600) 00010000:00010000:0.0:1790736284.096363:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526000/0x6aae200528fe6d11 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736284.096374:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526000/0x6aae200528fe6d11 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736284.096382:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526000/0x6aae200528fe6d11 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736284.096427:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790736284.096507:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+51:2356:x1877722797251456:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 219us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736284.096516:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 66 00010000:00010000:2.0:1790736284.096771:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6cf5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526fee expref: 50 pid: 8114 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736284.096792:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94150133f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1877722816128256:192.168.203.5@tcp:104: 00010000:00010000:2.0:1790736284.096817:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526000/0x6aae200528fe6d11 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736284.096827:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526000/0x6aae200528fe6d11 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736284.096833:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526000/0x6aae200528fe6d11 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790736284.096857:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1790736284.097064:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6d0a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526ffc expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736284.097083:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526000/0x6aae200528fe6d11 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526ffc expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736284.097090:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94160678a600) 00010000:00010000:2.0:1790736284.097732:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790736284.097736:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94163c526000, rc 0) 00000100:00100000:3.0:1790736284.098281:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+50:11435:x1877722797251328:12345-192.168.203.5@tcp:101:bash.0 Request processed in 6279us (6548us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1790736284.098293:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 159 00000100:00100000:3.0:1790736284.102617:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736284.102725:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797251712 00000100:00100000:2.0:1790736284.102739:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797251712 00000100:00100000:2.0:1790736284.102845:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 160 00000100:00100000:2.0:1790736284.102859:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+50:11435:x1877722797251712:12345-192.168.203.5@tcp:36:bash.0 00010000:00010000:2.0:1790736284.103236:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe6d1f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736284.103260:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe6d1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736284.103339:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe6d1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790736284.103549:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1790736284.103575:0:5844:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000518de05d reply state 00000000e2201bf9 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe6d1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736284.103586:0:5844:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790736284.103706:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+53:11435:x1877722797251712:12345-192.168.203.5@tcp:36:bash.0 Request processed in 848us (1105us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1790736284.103715:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 160 00000020:00080000:2.0:1790736284.103722:0:5844:0:(tgt_main.c:787:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790736284.108249:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe6d1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.108276:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe6d1f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.108285:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe6d1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.108293:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163c526a00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736284.108298:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe6d1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.108307:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe6d1f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.108346:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94160678a600) 00010000:00010000:1.0:1790736284.108350:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736284.108356:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe6d1f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.108364:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe6d1f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736284.109736:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736284.110553:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797251840 00000100:00100000:1.0:1790736284.110571:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797251840 00000100:00100000:1.0:1790736284.110697:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 161 00000100:00100000:1.0:1790736284.110710:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+52:11435:x1877722797251840:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:1.0:1790736284.110750:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736284.110778:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6d26 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a527003 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.110895:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6d2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.110913:0:8114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526000/0x6aae200528fe6d11 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526ffc expref: 53 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.110922:0:8114:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6d2d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.110967:0:8114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526000/0x6aae200528fe6d11 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0x92962417a526ffc expref: 53 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.110983:0:8114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526000/0x6aae200528fe6d11 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526ffc expref: 53 pid: 5845 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736284.111019:0:8114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941642042d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8114:1877722816128384:192.168.203.5@tcp:104: 00000100:00100000:1.0:1790736284.111168:0:8114:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607c03b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790736284.114464:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736284.115245:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797251968 00000100:00100000:2.0:1790736284.115260:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797251968 00010000:00010000:2.0:1790736284.115319:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526000/0x6aae200528fe6d11 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526ffc expref: 54 pid: 5845 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736284.115378:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 67 00000100:00100000:2.0:1790736284.115390:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+54:2356:x1877722797251968:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790736284.115818:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790736284.115831:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526000/0x6aae200528fe6d11 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526ffc expref: 54 pid: 5845 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736284.115849:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526000/0x6aae200528fe6d11 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526ffc expref: 54 pid: 5845 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736284.115880:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94160678a600) 00010000:00010000:2.0:1790736284.115885:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6d2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736284.115897:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6d2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736284.115906:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6d2d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736284.115929:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790736284.116071:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+54:2356:x1877722797251968:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 682us (1624us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736284.116081:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 67 00010000:00010000:1.0:1790736284.117201:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526000/0x6aae200528fe6d11 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0x92962417a526ffc expref: 53 pid: 5845 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736284.117230:0:8114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941642042d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8114:1877722816128384:192.168.203.5@tcp:104: 00010000:00010000:1.0:1790736284.117262:0:8114:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6d2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.117273:0:8114:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6d2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.117280:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6d2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790736284.117344:0:8114:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1790736284.117350:0:8114:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790736284.117377:0:8114:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6d2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.117426:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6d26 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527003 expref: 53 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.117443:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6d2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527003 expref: 52 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.117452:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94160678a600) 00010000:00010000:1.0:1790736284.117476:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790736284.117481:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c60c00, rc 0) 00000100:00100000:1.0:1790736284.117547:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+52:11435:x1877722797251840:12345-192.168.203.5@tcp:101:bash.0 Request processed in 6840us (7826us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736284.117556:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 161 00000100:00100000:0.0:1790736284.122699:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736284.123139:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797252224 00000100:00100000:1.0:1790736284.123153:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797252224 00000100:00100000:0.0:1790736284.123521:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 45 00000100:00100000:0.0:1790736284.123535:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162ed91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+52:11435:x1877722797252224:12345-192.168.203.5@tcp:35:bash.0 00000100:00100000:0.0:1790736284.123913:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162ed91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+53:11435:x1877722797252224:12345-192.168.203.5@tcp:35:bash.0 Request processed in 382us (1229us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1790736284.123922:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 45 00000100:00100000:2.0:1790736284.207600:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736284.207709:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797252480 00000100:00100000:3.0:1790736284.207725:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797252480 00000100:00100000:3.0:1790736284.207807:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 162 00000100:00100000:3.0:1790736284.207820:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94150133f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+53:11445:x1877722797252480:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1790736284.207856:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736284.207881:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6d34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a52700a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790736284.208020:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1790736284.208203:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6d34 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52700a expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.208220:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff941605242d00) 00010000:00010000:3.0:1790736284.208224:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790736284.208229:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6d34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52700a expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.208246:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c8e00, rc 0) 00000100:00100000:3.0:1790736284.208332:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94150133f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+54:11445:x1877722797252480:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 514us (746us total) trans 4294967451 rc 301/301 00000100:00100000:3.0:1790736284.208340:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 162 00000100:00100000:3.0:1790736284.211586:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736284.211679:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797252608 00000100:00100000:1.0:1790736284.211692:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797252608 00000100:00100000:1.0:1790736284.211770:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 163 00000100:00100000:1.0:1790736284.211782:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+54:11445:x1877722797252608:12345-192.168.203.5@tcp:34:lfs.0 00010000:00010000:1.0:1790736284.211890:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6d42 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.211911:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6d42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.211924:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6d42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.211940:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6d49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.211947:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6d49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.211953:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6d49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.212064:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6d50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.212228:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6d50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.212238:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6d50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790736284.212307:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6d50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.212324:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6d42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.212330:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6d42 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.212336:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6d42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.212343:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60600 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736284.212348:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6d42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.212356:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6d42 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.212370:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94161505de00) 00010000:00010000:1.0:1790736284.212373:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736284.212379:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6d42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.212386:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6d42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.212409:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6d49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.212425:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6d49 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.212431:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6d49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.212437:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c61400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736284.212441:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6d49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.212447:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6d49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.212456:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff941603253900) 00010000:00010000:1.0:1790736284.212458:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736284.212461:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6d49 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.212467:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6d49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.212485:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6d50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.212491:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6d50 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.212497:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6d50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.212508:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60a00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736284.212512:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6d50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.212518:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6d50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.212527:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94160678a600) 00010000:00010000:1.0:1790736284.212529:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736284.212532:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6d50 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.212538:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6d50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736284.212754:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+54:11445:x1877722797252608:12345-192.168.203.5@tcp:34:lfs.0 Request processed in 967us (1178us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736284.212765:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 163 00000100:00100000:0.0:1790736284.219800:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736284.219976:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797252864 00000100:00100000:2.0:1790736284.219990:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797252864 00000100:00100000:2.0:1790736284.220066:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 46 00000100:00100000:2.0:1790736284.220080:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162fafe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+54:11445:x1877722797252864:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:2.0:1790736284.220457:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162fafe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+55:11445:x1877722797252864:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 378us (670us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1790736284.220477:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 46 00000100:00100000:2.0:1790736284.263439:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736284.263937:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797253120 00000100:00100000:3.0:1790736284.263952:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797253120 00000100:00100000:3.0:1790736284.264079:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 164 00000100:00100000:3.0:1790736284.264127:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94150133fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+55:11448:x1877722797253120:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1790736284.264165:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736284.264193:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6d57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a527011 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.264290:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6d5e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.264307:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6d5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.264366:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6d5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.264385:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe6d65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.264393:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe6d65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.264400:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe6d65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.264561:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6d6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.264571:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6d6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.264578:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6d6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790736284.264589:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1790736284.264709:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6d5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.264717:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6d5e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.264724:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6d5e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.264730:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c9c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736284.264754:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6d5e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.264763:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6d5e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.264777:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94161505de00) 00010000:00010000:3.0:1790736284.264781:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736284.264785:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6d5e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.264792:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6d5e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.264807:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe6d65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.264814:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe6d65 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.264819:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe6d65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.264824:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c9400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736284.264827:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe6d65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.264833:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe6d65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.264850:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94161505d900) 00010000:00010000:3.0:1790736284.264852:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736284.264861:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe6d65 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.264867:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe6d65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.264918:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6d57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527011 expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.264933:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6d6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527011 expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.264941:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94160678a600) 00010000:00010000:3.0:1790736284.264943:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790736284.264946:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c8a00, rc 0) 00000100:00100000:3.0:1790736284.265033:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94150133fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+57:11448:x1877722797253120:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 943us (1618us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1790736284.265042:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 164 00000100:00100000:3.0:1790736284.271898:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736284.274016:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797253248 00000100:00100000:0.0:1790736284.274036:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797253248 00000100:00100000:0.0:1790736284.275028:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 165 00000100:00100000:0.0:1790736284.275046:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+57:11448:x1877722797253248:12345-192.168.203.5@tcp:54:lfs.0 00010000:00010000:0.0:1790736284.275170:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe6d7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736284.275194:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe6d7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736284.275208:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe6d7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736284.275242:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe6d7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736284.275250:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe6d7a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736284.275257:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe6d7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736284.275263:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9416013fe200 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736284.275274:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe6d7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736284.275305:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe6d7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736284.275321:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94160678a600) 00010000:00010000:0.0:1790736284.275324:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790736284.275331:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe6d7a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736284.275339:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe6d7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736284.275463:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+57:11448:x1877722797253248:12345-192.168.203.5@tcp:54:lfs.0 Request processed in 423us (3578us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736284.275471:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 165 00000100:00100000:2.0:1790736284.276523:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736284.285243:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797253376 00000100:00100000:0.0:1790736284.285269:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797253376 00000100:00100000:0.0:1790736284.285377:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 12 00000100:00100000:0.0:1790736284.285389:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94150133d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+57:2355:x1877722797253376:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790736284.285422:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790736284.285456:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6d6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527011 expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736284.285484:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94160678a600) 00010000:00010000:0.0:1790736284.285492:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790736284.286017:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94150133d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+56:2355:x1877722797253376:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 627us (10125us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736284.286029:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 12 00000100:00100000:1.0:1790736284.297229:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736284.297496:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797253632 00000100:00100000:2.0:1790736284.297510:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797253632 00000100:00100000:2.0:1790736284.298888:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 47 00000100:00100000:2.0:1790736284.298910:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+56:11448:x1877722797253632:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:2.0:1790736284.299385:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+57:11448:x1877722797253632:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 482us (2167us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1790736284.299395:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 47 00010000:00010000:1.0:1790736284.437477:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790736284.457691:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736284.457835:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797253888 00000100:00100000:1.0:1790736284.457848:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797253888 00000100:00100000:1.0:1790736284.457960:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 166 00000100:00100000:1.0:1790736284.457972:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94150133c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+57:11466:x1877722797253888:12345-192.168.203.5@tcp:101:cat.0 00010000:00010000:1.0:1790736284.458015:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736284.458043:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6d81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a527018 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.458194:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6d88 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.458230:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6d88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.458243:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6d88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790736284.458258:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1790736284.458452:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6d81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527018 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.458473:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6d88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527018 expref: 59 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.458483:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94160678a600) 00010000:00010000:1.0:1790736284.458486:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790736284.458491:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c60600, rc 0) 00000100:00100000:1.0:1790736284.458702:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94150133c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+59:11466:x1877722797253888:12345-192.168.203.5@tcp:101:cat.0 Request processed in 731us (1025us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1790736284.458711:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 166 00000100:00100000:1.0:1790736284.488061:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736284.488240:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797254016 00000100:00100000:0.0:1790736284.488254:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797254016 00000100:00100000:1.0:1790736284.488910:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 167 00000100:00100000:1.0:1790736284.488927:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642041c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+59:11467:x1877722797254016:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1790736284.488962:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736284.488991:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6d96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a52701f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.489137:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6d9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.489162:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6d9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.489174:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6d9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790736284.489920:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1790736284.489925:0:5845:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790736284.489953:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6d9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.489992:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6d96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52701f expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.490016:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6d9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52701f expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736284.490026:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94161505de00) 00010000:00010000:1.0:1790736284.490029:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790736284.490033:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c60800, rc 0) 00000100:00100000:1.0:1790736284.490188:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642041c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+60:11467:x1877722797254016:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1267us (2144us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736284.490198:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 167 00000100:00100000:2.0:1790736284.497913:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736284.499708:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797254400 00000100:00100000:0.0:1790736284.499727:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797254400 00000100:00100000:0.0:1790736284.499829:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 48 00000100:00100000:0.0:1790736284.499841:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94150133f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+60:11467:x1877722797254400:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:0.0:1790736284.500808:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94150133f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+61:11467:x1877722797254400:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 953us (2893us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1790736284.500818:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 48 00000100:00100000:2.0:1790736284.512859:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736284.513019:0:8527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797254528 00000100:00100000:3.0:1790736284.513033:0:8527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797254528 00000100:00100000:3.0:1790736284.513147:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 13 00000100:00100000:3.0:1790736284.513160:0:8527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94150133f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+61:11467:x1877722797254528:12345-192.168.203.5@tcp:103:lfs.0 00010000:00010000:3.0:1790736284.513180:0:8527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1790736284.513224:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6d2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527003 expref: 61 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.513253:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6d88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527018 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.513304:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526200/0x6aae200528fe6c38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526fc4 expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.513316:0:8527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94160678a600) 00010000:00010000:3.0:1790736284.513331:0:8527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790736284.513392:0:8527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94150133f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+58:11467:x1877722797254528:12345-192.168.203.5@tcp:103:lfs.0 Request processed in 236us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736284.513400:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 13 00000100:00100000:2.0:1790736284.520909:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736284.521082:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797254656 00000100:00100000:3.0:1790736284.521370:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797254656 00000100:00100000:3.0:1790736284.521468:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 168 00000100:00100000:3.0:1790736284.521480:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94150133e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+58:11467:x1877722797254656:12345-192.168.203.5@tcp:58:lfs.0 00010000:00010000:3.0:1790736284.521720:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6da4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.521743:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6da4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.521757:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6da4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790736284.523066:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1790736284.523544:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94150133e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+58:11467:x1877722797254656:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 2051us (2635us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736284.523558:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 168 00000100:00100000:1.0:1790736284.570888:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736284.571013:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797254784 00000100:00100000:3.0:1790736284.571026:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797254784 00000100:00100000:3.0:1790736284.571196:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 169 00000100:00100000:3.0:1790736284.571210:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642043100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+58:11469:x1877722797254784:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1790736284.571237:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736284.571264:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe6dab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a527026 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.571376:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6db2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.571398:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6db2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.571430:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6db2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.571451:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6db9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.571459:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6db9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.571466:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6db9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.571591:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6dc0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.571602:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.571609:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790736284.571671:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1790736284.571676:0:5845:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790736284.571701:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.571714:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.571723:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6db2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.571730:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6db2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.571738:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6db2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.571744:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c9c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736284.571749:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6db2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.571758:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6db2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.571772:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94161505de00) 00010000:00010000:3.0:1790736284.571775:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736284.571781:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6db2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.571787:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6db2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.571814:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6db9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.571820:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6db9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.571826:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6db9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.571831:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c8a00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736284.571835:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6db9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.571841:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6db9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.571849:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94161505d500) 00010000:00010000:3.0:1790736284.571852:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736284.571855:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6db9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.571862:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6db9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.571902:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe6dab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527026 expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.571918:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6dc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527026 expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736284.571938:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94161505d900) 00010000:00010000:3.0:1790736284.571940:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790736284.571943:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c8000, rc 0) 00000100:00100000:3.0:1790736284.572035:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642043100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+59:11469:x1877722797254784:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 827us (1691us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736284.572043:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 169 00000100:00100000:2.0:1790736284.673575:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736284.673622:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736284.674060:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797254912 00000100:00100000:0.0:1790736284.674075:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797254912 00000100:00100000:0.0:1790736284.674171:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 294 00000100:00100000:0.0:1790736284.674184:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606654850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+13:2356:x1877722797254912:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1790736284.674283:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606654850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+13:2356:x1877722797254912:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 101us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736284.674292:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 294 00000100:00100000:3.0:1790736284.675283:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797255168 00000100:00100000:3.0:1790736284.675295:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797255168 00000100:00100000:3.0:1790736284.675393:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 87 00000100:00100000:3.0:1790736284.675414:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94150133ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+7:2356:x1877722797255168:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736284.675487:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94150133ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+7:2356:x1877722797255168:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 86us (1865us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736284.675495:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 87 00000100:00080000:0.0:1790736284.677908:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790736284.682570:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736284.682703:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736284.682788:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797255040 00000100:00100000:3.0:1790736284.682802:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797255040 00000100:00100000:3.0:1790736284.682896:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 88 00000100:00100000:3.0:1790736284.682910:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2355:x1877722797255040:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736284.683014:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2355:x1877722797255040:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 108us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736284.683023:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 88 00000100:00080000:2.0:1790736284.683467:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790736284.683550:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797255296 00000100:00100000:0.0:1790736284.683558:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797255296 00000100:00100000:0.0:1790736284.683620:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 150 00000100:00100000:0.0:1790736284.683629:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2355:x1877722797255296:12345-192.168.203.5@tcp:400:kworker.0 00000100:00080000:2.0:1790736284.683818:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790736284.683880:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2355:x1877722797255296:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 252us (1176us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736284.683890:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 150 00000100:00100000:2.0:1790736284.821459:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941502bfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1877722816128768:0@lo:400:kworker.0 00000100:00100000:2.0:1790736284.821575:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736284.821656:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790736284.821663:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941502bfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816128896:0@lo:400:kworker.0 00000100:00100000:2.0:1790736284.821692:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736284.821859:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816128768 00000100:00100000:2.0:1790736284.821879:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816128768 00000100:00100000:2.0:1790736284.821953:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1790736284.821964:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941502bfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877722816128768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736284.822033:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941502bfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877722816128768:12345-0@lo:400:kworker.0 Request processed in 71us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736284.822041:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1790736284.822071:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816128896 00000100:00100000:2.0:1790736284.822075:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816128896 00000100:00100000:3.0:1790736284.822436:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b30ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816128512:0@lo:400:kworker.0 00000100:00100000:3.0:1790736284.822483:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736284.822517:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941502bff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1877722816129024:0@lo:400:kworker.0 00000100:00100000:3.0:1790736284.822558:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736284.822581:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1790736284.822587:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877722816128640:0@lo:400:kworker.0 00000100:00100000:3.0:1790736284.822612:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736284.822631:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941502bfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816129152:0@lo:400:kworker.0 00000100:00100000:3.0:1790736284.822655:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736284.822684:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816129024 00000100:00100000:3.0:1790736284.822689:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816129024 00000100:00100000:3.0:1790736284.822791:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1790736284.822801:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877722816129024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736284.822844:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877722816129024:12345-0@lo:400:kworker.0 Request processed in 45us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736284.822851:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1790736284.822865:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816128640 00000100:00100000:3.0:1790736284.822868:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816128640 00000100:00100000:3.0:1790736284.822883:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1790736284.822888:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877722816128640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736284.822915:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877722816128640:12345-0@lo:400:kworker.0 Request processed in 27us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736284.822921:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1790736284.822965:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877722816128640:0@lo:400:kworker.0 00000100:00100000:3.0:1790736284.822977:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941502bff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1877722816129024:0@lo:400:kworker.0 00000100:00100000:2.0:1790736284.823349:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816129152 00000100:00100000:2.0:1790736284.823354:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816129152 00000100:00100000:2.0:1790736284.823386:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1790736284.823394:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941502bfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816128896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736284.823444:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941502bfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816128896:12345-0@lo:400:kworker.0 Request processed in 51us (1750us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736284.823450:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1790736284.823463:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1790736284.823469:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1877722816129152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736284.823502:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1877722816129152:12345-0@lo:400:kworker.0 Request processed in 34us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736284.823508:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:2.0:1790736284.823525:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790736284.823530:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790736284.823544:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816128512 00000100:00100000:2.0:1790736284.823548:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816128512 00000100:00100000:2.0:1790736284.823573:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1790736284.823579:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606655450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+19:3306:x1877722816128512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736284.823610:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606655450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+19:3306:x1877722816128512:12345-0@lo:400:kworker.0 Request processed in 31us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736284.823626:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1790736284.823681:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941502bfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816128896:0@lo:400:kworker.0 00000100:00100000:2.0:1790736284.823692:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941502bfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1877722816128768:0@lo:400:kworker.0 00000100:00100000:2.0:1790736284.825779:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941502bfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816129152:0@lo:400:kworker.0 00000100:00100000:2.0:1790736284.825820:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b30ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816128512:0@lo:400:kworker.0 00000004:00080000:0.0:1790736285.339737:0:7910:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 357350322414ns, next at 358350319382ns, rc = 0 00000100:00100000:2.0:1790736285.346290:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790736285.346340:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162fafca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816129280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790736285.346484:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736285.347148:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816129280 00000100:00100000:3.0:1790736285.347162:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816129280 00000100:00100000:3.0:1790736285.347229:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790736285.347240:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f093050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1877722816129280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790736285.347307:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790736285.347388:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f093050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1877722816129280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 149us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736285.347397:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790736285.347451:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162fafca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816129280:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1790736285.443023:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000020:00080000:0.0:1790736285.443075:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff941607c03cc0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1790736285.443081:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff941633820000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff941607c03d80 00000020:00080000:0.0:1790736285.443084:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff941633820600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94160722ac00 00000004:00080000:0.0:1790736285.443160:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1790736285.443184:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1790736285.443575:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1790736285.443687:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162fafdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816129408:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1790736285.443762:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736285.443831:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816129408 00000100:00100000:0.0:1790736285.443841:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816129408 00000100:00100000:0.0:1790736285.443881:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790736285.443889:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162fafd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1877722816129408:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1790736285.443917:0:6699:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:0.0:1790736285.443948:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6abc779a, atime: 0x6abc779b, ctime: 0x6abc779a, blocks: 0x1 00010000:00010000:0.0:1790736285.443956:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d0433f0/0x6aae200528fe6dc7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.443973:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=357s v=(0 0) 00010000:00010000:0.0:1790736285.443978:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736285.443984:0:6699:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d0433f0/0x6aae200528fe6dc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.444001:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d0433f0/0x6aae200528fe6dc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.444011:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d0433f0/0x6aae200528fe6dc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.444028:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d0433f0/0x6aae200528fe6dc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.444045:0:6699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790736285.448201:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162fafd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3309:x1877722816129408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4306us (4433us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1790736285.448214:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:0.0:1790736285.448249:0:11186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790736285.448258:0:11186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d0433f0/0x6aae200528fe6dc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.449500:0:11186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9416013ff400 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:0.0:1790736285.449506:0:11186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d0433f0/0x6aae200528fe6dc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.449517:0:11186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d0433f0/0x6aae200528fe6dc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.449537:0:11186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d0433f0/0x6aae200528fe6dc7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.449545:0:11186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d0433f0/0x6aae200528fe6dc7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.449565:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736285.449574:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736285.449577:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1790736285.449670:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94162fafdf80/2, rc 0, transno 4294967307 00000100:00100000:2.0:1790736285.449678:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162fafdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816129408:0@lo:6:osp-syn-1-0.0 00000040:00080000:2.0:1790736285.462665:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790736285.462675:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790736285.462717:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:2.0:1790736285.462724:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790736285.462854:0:11704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941502bfce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11704:1877722816129536:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790736285.462954:0:11704:0:(client.c:2716:ptlrpc_set_wait()) set ffff94161871a540 going to sleep for 11 seconds 00010000:00010000:0.0:1790736285.463420:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790736285.463480:0:12431:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790736285.463485:0:12431:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790736285.463525:0:12431:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:0.0:1790736285.463530:0:12431:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790736285.466981:0:11704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941502bfce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11704:1877722816129536:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790736285.469151:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736285.469319:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797255424 00000100:00100000:1.0:1790736285.469328:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797255424 00000100:00100000:1.0:1790736285.469394:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 170 00000100:00100000:1.0:1790736285.469414:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+17:11481:x1877722797255424:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790736285.469461:0:5844:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790736285.469569:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+17:11481:x1877722797255424:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 165us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736285.469577:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 170 00000100:00100000:1.0:1790736285.480792:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736285.480856:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797255552 00000100:00100000:2.0:1790736285.480868:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797255552 00000100:00100000:2.0:1790736285.480935:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 171 00000100:00100000:2.0:1790736285.480947:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+17:11481:x1877722797255552:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1790736285.481031:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6dce lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.481050:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6dce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.481062:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6dce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.481135:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527400/0x6aae200528fe6dd5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.481144:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527400/0x6aae200528fe6dd5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.481150:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527400/0x6aae200528fe6dd5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.481175:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526e00/0x6aae200528fe6ddc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.481183:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526e00/0x6aae200528fe6ddc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.481190:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526e00/0x6aae200528fe6ddc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790736285.481224:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1790736285.481228:0:5845:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790736285.481240:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526e00/0x6aae200528fe6ddc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.481250:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6dce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.481273:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6dce lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.481279:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6dce lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.481285:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163c526600 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736285.481289:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6dce lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.481297:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6dce lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.481308:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94160678a900) 00010000:00010000:2.0:1790736285.481311:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790736285.481315:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6dce lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.481321:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6dce lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.481331:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527400/0x6aae200528fe6dd5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.481336:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527400/0x6aae200528fe6dd5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.481350:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527400/0x6aae200528fe6dd5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.481355:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163c527400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736285.481365:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527400/0x6aae200528fe6dd5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.481371:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527400/0x6aae200528fe6dd5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.481379:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff94160678a400) 00010000:00010000:2.0:1790736285.481381:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790736285.481383:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527400/0x6aae200528fe6dd5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.481388:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527400/0x6aae200528fe6dd5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.481411:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526e00/0x6aae200528fe6ddc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.481417:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526e00/0x6aae200528fe6ddc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.481422:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526e00/0x6aae200528fe6ddc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.481426:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163c526e00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736285.481428:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526e00/0x6aae200528fe6ddc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.481434:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526e00/0x6aae200528fe6ddc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.481440:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94161505d900) 00010000:00010000:2.0:1790736285.481442:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790736285.481451:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526e00/0x6aae200528fe6ddc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.481456:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526e00/0x6aae200528fe6ddc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736285.482730:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+17:11481:x1877722797255552:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 Request processed in 1780us (1939us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736285.482741:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 171 00000100:00100000:2.0:1790736285.485986:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736285.486057:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797255808 00000100:00100000:3.0:1790736285.486068:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797255808 00000100:00100000:3.0:1790736285.486146:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 172 00000100:00100000:3.0:1790736285.486156:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941502bfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+17:11481:x1877722797255808:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790736285.486182:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736285.486206:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6de3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a52702d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.486320:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe6dea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.486336:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe6dea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.486358:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe6dea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790736285.486369:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1790736285.486749:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe6dea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.486759:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe6dea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.486766:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe6dea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.486786:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c9400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736285.486791:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe6dea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.486798:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe6dea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.486810:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94161505d900) 00010000:00010000:3.0:1790736285.486813:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790736285.486818:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe6dea lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.486823:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe6dea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.486866:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6de3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52702d expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.486875:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94160678a900) 00010000:00010000:3.0:1790736285.486876:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790736285.486880:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6de3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52702d expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.486887:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c8a00, rc 0) 00000100:00100000:3.0:1790736285.486950:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941502bfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+18:11481:x1877722797255808:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 796us (972us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1790736285.486959:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 172 00000100:00100000:3.0:1790736285.508959:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736285.510501:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797255936 00000100:00100000:2.0:1790736285.510522:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797255936 00000100:00100000:2.0:1790736285.510587:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 173 00000100:00100000:2.0:1790736285.510596:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+18:11481:x1877722797255936:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790736285.510646:0:8114:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790736285.517757:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+18:11481:x1877722797255936:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 7150us (8795us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736285.517772:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 173 00000100:00100000:3.0:1790736285.524877:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736285.526271:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797256192 00000100:00100000:2.0:1790736285.526287:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797256192 00000100:00100000:3.0:1790736285.526571:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 174 00000100:00100000:3.0:1790736285.526583:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+18:11481:x1877722797256192:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790736285.526607:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736285.526610:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790736285.526639:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6d9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52701f expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.526657:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94161505de00) 00010000:00010000:3.0:1790736285.526662:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790736285.526674:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6df8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a527034 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790736285.527787:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1790736285.528014:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6dff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.528030:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6dff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.528040:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6dff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.528131:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6df8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527034 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.528147:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6dff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527034 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.528167:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94161505d300) 00010000:00010000:3.0:1790736285.528169:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790736285.528171:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c8a00, rc 0) 00000100:00100000:3.0:1790736285.528234:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+19:11481:x1877722797256192:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 1652us (3367us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1790736285.528241:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 174 00000100:00100000:3.0:1790736285.531995:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736285.532056:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797256448 00000100:00100000:1.0:1790736285.532066:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797256448 00000100:00100000:1.0:1790736285.532130:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 175 00000100:00100000:1.0:1790736285.532142:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f243b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+19:11481:x1877722797256448:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790736285.532209:0:8114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736285.532239:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe6dff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527034 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.532257:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94161505d300) 00010000:00010000:1.0:1790736285.532284:0:8114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790736285.532306:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6e0d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.532322:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6e0d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.532331:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6e0d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.532413:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6e14 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xa279722b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.532428:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6e14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa279722b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.532452:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6e14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa279722b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.532677:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6e0d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.532686:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6e0d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.532692:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6e0d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.532698:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c61400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736285.532702:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6e0d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.532709:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6e0d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.532717:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94161505de00) 00010000:00010000:1.0:1790736285.532719:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736285.532723:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6e0d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.532728:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6e0d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.532736:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6e14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa279722b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.532741:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6e14 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa279722b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.532756:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6e14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa279722b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.532760:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60a00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736285.532762:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6e14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa279722b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.532768:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6e14 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa279722b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.532774:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xa279722b (ffff941603253300) 00010000:00010000:1.0:1790736285.532776:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736285.532779:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6e14 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa279722b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.532783:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6e14 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa279722b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736285.533954:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f243b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+18:11481:x1877722797256448:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 1806us (1960us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790736285.533965:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 175 00000100:00100000:1.0:1790736285.538876:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736285.538938:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797256576 00000100:00100000:2.0:1790736285.538948:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797256576 00000100:00100000:2.0:1790736285.539001:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 176 00000100:00100000:2.0:1790736285.539010:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+18:11481:x1877722797256576:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790736285.539029:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736285.539052:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6e1b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a52703b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.539085:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527a00/0x6aae200528fe6e22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.539129:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527a00/0x6aae200528fe6e22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.539141:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527a00/0x6aae200528fe6e22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.539229:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526600/0x6aae200528fe6e1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52703b expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.539242:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527a00/0x6aae200528fe6e22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52703b expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.539250:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94160678a400) 00010000:00010000:2.0:1790736285.539252:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790736285.539255:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94163c527a00, rc 0) 00000100:00100000:2.0:1790736285.539316:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+19:11481:x1877722797256576:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 306us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736285.539324:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 176 00000100:00100000:1.0:1790736285.544061:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736285.544318:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797256832 00000100:00100000:2.0:1790736285.544331:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797256832 00000100:00100000:2.0:1790736285.545811:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 177 00000100:00100000:2.0:1790736285.545826:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642042300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+19:11481:x1877722797256832:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790736285.545911:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527800/0x6aae200528fe6e29 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.545928:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527800/0x6aae200528fe6e29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.545948:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527800/0x6aae200528fe6e29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790736285.546974:0:8114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1790736285.546992:0:8114:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 357557897992ns, next at 358557894316ns, rc = 0 00000004:00010000:3.0:1790736285.547087:0:8114:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000058086d1c reply state 000000008743a973 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527800/0x6aae200528fe6e29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736285.547215:0:8114:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790736285.548073:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642042300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+21:11481:x1877722797256832:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 2246us (4019us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1790736285.548084:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 177 00000100:00100000:3.0:1790736285.552131:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736285.552165:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797256960 00000100:00100000:2.0:1790736285.552176:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797256960 00000100:00100000:2.0:1790736285.552241:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 178 00000100:00100000:2.0:1790736285.552252:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f241180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+21:11481:x1877722797256960:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790736285.552287:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736285.552311:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527600/0x6aae200528fe6e30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a527042 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.552387:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527600/0x6aae200528fe6e30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527042 expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.552421:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527600/0x6aae200528fe6e30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527042 expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.552442:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94160678a400) 00010000:00010000:2.0:1790736285.552446:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790736285.552450:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94163c527600, rc 0) 00000100:00100000:2.0:1790736285.552511:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f241180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+22:11481:x1877722797256960:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 262us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736285.552518:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 178 00010000:00010000:0.0:1790736285.553378:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527800/0x6aae200528fe6e29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.553393:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527800/0x6aae200528fe6e29 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.553410:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527800/0x6aae200528fe6e29 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.553416:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163c527800 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736285.553422:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527800/0x6aae200528fe6e29 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.553431:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527800/0x6aae200528fe6e29 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.553451:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94160678a400) 00010000:00010000:0.0:1790736285.553455:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790736285.553459:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527800/0x6aae200528fe6e29 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.553467:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527800/0x6aae200528fe6e29 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736285.556165:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736285.556210:0:8632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797257088 00000100:00100000:2.0:1790736285.556221:0:8632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797257088 00000100:00100000:2.0:1790736285.556283:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 51 00000100:00100000:2.0:1790736285.556292:0:8632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f240380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2354:x1877722797257088:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1790736285.556991:0:8632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f240380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+7:2354:x1877722797257088:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 Request processed in 355us (489us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1790736285.557002:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 51 00000100:00100000:2.0:1790736285.559937:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736285.560024:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797257344 00000100:00100000:3.0:1790736285.560035:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797257344 00000100:00100000:3.0:1790736285.560089:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 49 00000100:00100000:3.0:1790736285.560123:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941502bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+21:11481:x1877722797257344:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790736285.560583:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941502bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+22:11481:x1877722797257344:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 460us (654us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1790736285.560591:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 49 00000100:00100000:2.0:1790736285.568653:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736285.568961:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797257600 00000100:00100000:0.0:1790736285.568981:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797257600 00000100:00100000:0.0:1790736285.569052:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 179 00000100:00100000:0.0:1790736285.569062:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941502bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+22:11481:x1877722797257600:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790736285.569195:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941502bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+22:11481:x1877722797257600:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 133us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736285.569202:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 179 00000100:00100000:2.0:1790736285.575938:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736285.576491:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797257728 00000100:00100000:3.0:1790736285.576503:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797257728 00000100:00100000:3.0:1790736285.576559:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 180 00000100:00100000:3.0:1790736285.576569:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941502bfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+22:11481:x1877722797257728:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790736285.576597:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736285.576616:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6e37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a527049 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.576797:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe6e3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.576811:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe6e3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.576822:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe6e3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790736285.576859:0:5843:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790736285.576877:0:5843:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe6e3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.576901:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6e37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527049 expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.576914:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe6e3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527049 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.576923:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94160678a400) 00010000:00010000:3.0:1790736285.576925:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790736285.576929:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c9400, rc 0) 00000100:00100000:3.0:1790736285.577030:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941502bfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+23:11481:x1877722797257728:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 462us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736285.577037:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 180 00000100:00100000:2.0:1790736285.584790:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736285.585600:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797257856 00000100:00100000:0.0:1790736285.585610:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797257856 00000100:00100000:0.0:1790736285.585667:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 52 00000100:00100000:0.0:1790736285.585678:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941502bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+7:2354:x1877722797257856:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790736285.585696:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736285.585716:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083374fc2/0x6aae200528fe6e45 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a527050 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790736285.585744:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abc779e, blocks: 0x1 00010000:00010000:0.0:1790736285.585765:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=357s v=(0 0) 00010000:00010000:0.0:1790736285.585769:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736285.585779:0:6699:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083374fc2/0x6aae200528fe6e45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527050 expref: 8 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.585796:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000083374fc2/0x6aae200528fe6e45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527050 expref: 8 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.585808:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9416013ffc00, rc 0) 00000100:00100000:0.0:1790736285.585867:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941502bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+8:2354:x1877722797257856:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 191us (1086us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736285.585889:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 52 00000100:00100000:1.0:1790736285.590550:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736285.590617:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797258112 00000100:00100000:0.0:1790736285.590626:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797258112 00000100:00100000:0.0:1790736285.590681:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 181 00000100:00100000:0.0:1790736285.590691:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+23:11481:x1877722797258112:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790736285.590796:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+23:11481:x1877722797258112:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 106us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736285.590804:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 181 00000100:00100000:2.0:1790736285.594850:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736285.594955:0:8632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797258240 00000100:00100000:0.0:1790736285.594966:0:8632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797258240 00000100:00100000:0.0:1790736285.595016:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 53 00000100:00100000:0.0:1790736285.595026:0:8632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941502bfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+8:11481:x1877722797258240:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790736285.595043:0:8632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736285.595063:0:8632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d9eb69e/0x6aae200528fe6e4c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a527057 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.595125:0:8632:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000083374fc2/0x6aae200528fe6e45 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527050 expref: 9 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.595135:0:8632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736285.595139:0:8632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736285.595144:0:8632:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d9eb69e/0x6aae200528fe6e4c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527057 expref: 9 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.595175:0:8632:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000083374fc2/0x6aae200528fe6e45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0x92962417a527050 expref: 9 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.595197:0:8632:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000083374fc2/0x6aae200528fe6e45 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527050 expref: 9 pid: 6699 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736285.595210:0:8632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162fafc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8632:1877722816129664:192.168.203.5@tcp:104: 00000100:00100000:0.0:1790736285.595371:0:8632:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162a685540 going to sleep for 11 seconds 00000100:00100000:2.0:1790736285.600383:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736285.600628:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797258368 00000100:00100000:0.0:1790736285.600637:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797258368 00010000:00010000:0.0:1790736285.600680:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000083374fc2/0x6aae200528fe6e45 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527050 expref: 10 pid: 6699 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736285.600721:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 68 00000100:00100000:0.0:1790736285.600730:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941502bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+10:2355:x1877722797258368:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790736285.600745:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790736285.600771:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000083374fc2/0x6aae200528fe6e45 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527050 expref: 10 pid: 6699 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.600783:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000083374fc2/0x6aae200528fe6e45 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527050 expref: 10 pid: 6699 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.600807:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736285.600812:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736285.600821:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001d9eb69e/0x6aae200528fe6e4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527057 expref: 10 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.600845:0:5829:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d9eb69e/0x6aae200528fe6e4c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527057 expref: 10 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.600880:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001d9eb69e/0x6aae200528fe6e4c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527057 expref: 10 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736285.600895:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162faff480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5829:1877722816129792:192.168.203.5@tcp:105: 00000100:00100000:0.0:1790736285.600977:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162a685840 going to sleep for 11 seconds 00010000:00010000:0.0:1790736285.601021:0:8632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083374fc2/0x6aae200528fe6e45 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527050 expref: 10 pid: 6699 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736285.601036:0:8632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162fafc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8632:1877722816129664:192.168.203.5@tcp:104: 00010000:00010000:0.0:1790736285.601060:0:8632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001d9eb69e/0x6aae200528fe6e4c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0x92962417a527057 expref: 9 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.601071:0:8632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9416013fe400, rc 0) 00000100:00100000:0.0:1790736285.601116:0:8632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941502bfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+9:11481:x1877722797258240:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 6091us (6274us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736285.601123:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 53 00000100:00100000:3.0:1790736285.607144:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162faff480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5829:1877722816129792:192.168.203.5@tcp:105: 00010000:00010000:3.0:1790736285.607174:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790736285.607225:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941502bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+8:2355:x1877722797258368:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 6496us (6852us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736285.607237:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 68 00000100:00100000:2.0:1790736285.609513:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736285.609617:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797258496 00000100:00100000:3.0:1790736285.609639:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797258496 00002000:00100000:3.0:1790736285.609713:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff941502bff480 x1877722797258496/t0(0) o4->f945944d-9086-46a2-a91c-8bc7b88e8918@192.168.203.5@tcp:116/0 lens 504/0 e 0 to 0 dl 1790736296 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790736285.609727:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff941502bff480 with x1877722797258496 ext(0->8) 00002000:00010000:3.0:1790736285.609735:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff941502bff480 00000100:00100000:3.0:1790736285.609775:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 4 00000100:00100000:3.0:1790736285.609789:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941502bff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+8:2354:x1877722797258496:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1790736285.611041:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941502bff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+10:2354:x1877722797258496:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 1246us (1526us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1790736285.611055:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 4 00002000:00100000:3.0:1790736285.611068:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff941502bff480 x1877722797258496/t4294967314(0) o4->f945944d-9086-46a2-a91c-8bc7b88e8918@192.168.203.5@tcp:116/0 lens 504/448 e 0 to 0 dl 1790736296 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790736285.611079:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff941502bff480 with x1877722797258496 ext(0->8) 00002000:00010000:3.0:1790736285.611085:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff941502bff480 00000100:00100000:2.0:1790736285.613735:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736285.613815:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797258624 00000100:00100000:1.0:1790736285.613834:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797258624 00000100:00100000:1.0:1790736285.613907:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 182 00000100:00100000:1.0:1790736285.613920:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941502bffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+23:11481:x1877722797258624:12345-192.168.203.5@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1790736285.677817:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941502bffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+23:11481:x1877722797258624:12345-192.168.203.5@tcp:44:lhsmtool_posix.0 Request processed in 63881us (64083us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736285.677836:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 182 00000020:00080000:0.0:1790736285.680158:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:0.0:1790736285.680193:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000001:00080000:0.0:1790736285.680222:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:0.0:1790736285.680234:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:1.0:1790736285.680719:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1790736285.680733:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1790736285.682159:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736285.682294:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797258752 00000100:00100000:1.0:1790736285.682616:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162fafc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816129920:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1790736285.682734:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736285.682788:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797258752 00000100:00100000:3.0:1790736285.682859:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816129920 00000100:00100000:3.0:1790736285.682864:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816129920 00000100:00100000:3.0:1790736285.682910:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 54 00000100:00100000:3.0:1790736285.682922:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+10:2354:x1877722797258752:12345-192.168.203.5@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1790736285.683019:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790736285.683026:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642041880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816129920:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1790736285.683242:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1790736285.683247:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1790736286 00002000:00010000:3.0:1790736285.683250:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1790736285.683253:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1790736286 -> 1790736286 00002000:00010000:3.0:1790736285.683256:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00080000:2.0:1790736285.683834:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790736285.690738:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642041880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1877722816129920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 7694us (7985us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1790736285.690759:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000004:00080000:1.0:1790736285.691477:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94162fafc000/2, rc 0, transno 4294967315 00000100:00100000:1.0:1790736285.691490:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162fafc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816129920:0@lo:2:osp-syn-0-0.0 00000001:00080000:2.0:1790736285.778172:0:6725:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:2.0:1790736285.778194:0:6725:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:2.0:1790736285.778202:0:6725:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:0.0:1790736285.778749:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+7:2354:x1877722797258752:12345-192.168.203.5@tcp:16:lhsmtool_posix.0 Request processed in 95818us (96590us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736285.778782:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 54 00000100:00100000:2.0:1790736285.786936:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736285.787054:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797259008 00000100:00100000:1.0:1790736285.787069:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797259008 00000100:00100000:0.0:1790736285.787882:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 183 00000100:00100000:0.0:1790736285.787900:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941502bfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+19:11481:x1877722797259008:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790736285.788047:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790736285.788149:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe6e3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527049 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.788174:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94160678a400) 00010000:00010000:0.0:1790736285.788179:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790736285.788221:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ffc00/0x6aae200528fe6e53 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.788239:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ffc00/0x6aae200528fe6e53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.788249:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ffc00/0x6aae200528fe6e53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790736285.789829:0:5845:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000dd4710ca reply state 000000005ba65964 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ffc00/0x6aae200528fe6e53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736285.789852:0:5845:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790736285.790032:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941502bfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+20:11481:x1877722797259008:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 2132us (3108us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1790736285.790043:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 183 00010000:00010000:0.0:1790736285.791921:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ffc00/0x6aae200528fe6e53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.791967:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ffc00/0x6aae200528fe6e53 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.791976:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ffc00/0x6aae200528fe6e53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.791983:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9416013ffc00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736285.791989:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ffc00/0x6aae200528fe6e53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.791998:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ffc00/0x6aae200528fe6e53 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.792020:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94160678a400) 00010000:00010000:0.0:1790736285.792023:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736285.792030:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ffc00/0x6aae200528fe6e53 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.792037:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ffc00/0x6aae200528fe6e53 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736285.793798:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736285.793922:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797259136 00000100:00100000:0.0:1790736285.793935:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797259136 00000100:00100000:0.0:1790736285.796320:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 56 00000100:00100000:0.0:1790736285.796350:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941502bfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+7:2356:x1877722797259136:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1790736285.796731:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1790736285.796736:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1790736286 -> 1790736284 00002000:00010000:0.0:1790736285.796738:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1790736283 00002000:00010000:0.0:1790736285.796741:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1790736286 -> 1790736284 00002000:00010000:0.0:1790736285.796762:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1790736285.796860:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941502bfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+8:2356:x1877722797259136:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 Request processed in 523us (3076us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1790736285.796869:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 56 00000100:00100000:2.0:1790736285.800121:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736285.802500:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797259392 00000100:00100000:3.0:1790736285.802523:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797259392 00000100:00100000:3.0:1790736285.802751:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 184 00000100:00100000:3.0:1790736285.802764:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941502bfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+19:11481:x1877722797259392:12345-192.168.203.5@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1790736285.802880:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6e5a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.802902:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527a00/0x6aae200528fe6e22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52703b expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.802913:0:5843:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6e5a lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.802959:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527a00/0x6aae200528fe6e22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0x92962417a52703b expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.802976:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527a00/0x6aae200528fe6e22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a52703b expref: 19 pid: 5843 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736285.803019:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f241880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1877722816130048:192.168.203.5@tcp:104: 00000100:00100000:3.0:1790736285.803202:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff94160730c300 going to sleep for 11 seconds 00000100:00100000:2.0:1790736285.811177:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f241880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1877722816130048:192.168.203.5@tcp:104: 00010000:00010000:2.0:1790736285.811220:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6e5a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736285.811447:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736285.811535:0:8527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797259520 00000100:00100000:2.0:1790736285.811545:0:8527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797259520 00010000:00010000:2.0:1790736285.811608:0:8527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527a00/0x6aae200528fe6e22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a52703b expref: 20 pid: 5843 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736285.812036:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 69 00000100:00100000:2.0:1790736285.812049:0:8527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160557e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+20:2355:x1877722797259520:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790736285.812071:0:8527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790736285.812081:0:8527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527a00/0x6aae200528fe6e22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a52703b expref: 20 pid: 5843 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.812121:0:8527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527a00/0x6aae200528fe6e22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a52703b expref: 20 pid: 5843 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.812149:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527a00/0x6aae200528fe6e22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0x92962417a52703b expref: 20 pid: 5843 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.812185:0:8527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94160678a400) 00010000:00010000:2.0:1790736285.812191:0:8527:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6e5a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.812202:0:8527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6e5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.812210:0:8527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6e5a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.812242:0:8527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790736285.812303:0:8527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160557e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+19:2355:x1877722797259520:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 255us (857us total) trans 0 rc 0/0 00010000:00010000:1.0:1790736285.812356:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6e5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.812364:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6e5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.812408:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6e5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.812417:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6e5a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.812433:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6e5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.812440:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c9c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736285.812455:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6e5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.812465:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6e5a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.812480:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94160678a400) 00010000:00010000:1.0:1790736285.812484:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1790736285.812488:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6e5a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.812495:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6e5a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736285.812544:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941502bfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+19:11481:x1877722797259392:12345-192.168.203.5@tcp:55:lhsmtool_posix.0 Request processed in 9783us (12457us total) trans 0 rc -22/-22 00000100:00100000:1.0:1790736285.812554:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 184 00000100:00100000:2.0:1790736285.813646:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 69 00000100:00100000:0.0:1790736285.816014:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736285.816491:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797259648 00000100:00100000:3.0:1790736285.816504:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797259648 00000100:00100000:3.0:1790736285.816601:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 57 00000100:00100000:3.0:1790736285.816611:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162faffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+8:2353:x1877722797259648:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1790736285.816668:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000768e8c13/0x6aae200528fe6e61 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.816695:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001d9eb69e/0x6aae200528fe6e4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0x92962417a527057 expref: 8 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.816706:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790736285.816711:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790736285.816717:0:6697:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000768e8c13/0x6aae200528fe6e61 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.816770:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001d9eb69e/0x6aae200528fe6e4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.5@tcp remote: 0x92962417a527057 expref: 8 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.816787:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001d9eb69e/0x6aae200528fe6e4c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a527057 expref: 8 pid: 8632 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736285.816805:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f242a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6697:1877722816130176:192.168.203.5@tcp:104: 00000100:00100000:3.0:1790736285.816965:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff94160730cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1790736285.820013:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f242a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6697:1877722816130176:192.168.203.5@tcp:104: 00010000:00010000:3.0:1790736285.820069:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000768e8c13/0x6aae200528fe6e61 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736285.822656:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736285.822924:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797259776 00000100:00100000:3.0:1790736285.822938:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797259776 00010000:00010000:3.0:1790736285.822996:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001d9eb69e/0x6aae200528fe6e4c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a527057 expref: 9 pid: 8632 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736285.823055:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 70 00000100:00100000:3.0:1790736285.823067:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162fafc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+9:2356:x1877722797259776:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790736285.823087:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790736285.823171:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001d9eb69e/0x6aae200528fe6e4c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a527057 expref: 9 pid: 8632 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.823187:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001d9eb69e/0x6aae200528fe6e4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a527057 expref: 9 pid: 8632 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.823219:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d9eb69e/0x6aae200528fe6e4c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.5@tcp remote: 0x92962417a527057 expref: 9 pid: 8632 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.823242:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790736285.823247:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790736285.823254:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000768e8c13/0x6aae200528fe6e61 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.823302:0:5830:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000768e8c13/0x6aae200528fe6e61 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.823336:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790736285.823419:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162fafc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+8:2356:x1877722797259776:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 354us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736285.823429:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 70 00010000:00010000:1.0:1790736285.823581:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000768e8c13/0x6aae200528fe6e61 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.823593:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000768e8c13/0x6aae200528fe6e61 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.823624:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000768e8c13/0x6aae200528fe6e61 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.823635:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000768e8c13/0x6aae200528fe6e61 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.823667:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000768e8c13/0x6aae200528fe6e61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.823674:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c9800 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:1.0:1790736285.823679:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000768e8c13/0x6aae200528fe6e61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.823690:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000768e8c13/0x6aae200528fe6e61 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.823703:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000768e8c13/0x6aae200528fe6e61 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.823712:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000768e8c13/0x6aae200528fe6e61 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736285.823785:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162faffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+7:2353:x1877722797259648:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 7175us (7786us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736285.823794:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 57 00000100:00100000:0.0:1790736285.828915:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736285.830620:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797260032 00000100:00100000:1.0:1790736285.830639:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797260032 00000100:00100000:1.0:1790736285.830729:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 185 00000100:00100000:1.0:1790736285.830741:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162fafd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+18:11481:x1877722797260032:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1790736285.831299:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe6e68 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.831343:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe6e68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.831357:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe6e68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.831922:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6e6f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.831943:0:8114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527600/0x6aae200528fe6e30 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527042 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.831981:0:8114:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6e6f lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.832045:0:8114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527600/0x6aae200528fe6e30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0x92962417a527042 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.832388:0:8114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527600/0x6aae200528fe6e30 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527042 expref: 19 pid: 5843 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736285.832416:0:8114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941642040000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8114:1877722816130304:192.168.203.5@tcp:104: 00000100:00100000:1.0:1790736285.832642:0:8114:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416057689c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790736285.835756:0:8114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941642040000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8114:1877722816130304:192.168.203.5@tcp:104: 00010000:00010000:1.0:1790736285.835801:0:8114:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6e6f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736285.836700:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736285.836948:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797260160 00000100:00100000:2.0:1790736285.836959:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797260160 00010000:00010000:2.0:1790736285.837005:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527600/0x6aae200528fe6e30 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527042 expref: 20 pid: 5843 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736285.837063:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 71 00000100:00100000:2.0:1790736285.837074:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162fafd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+20:2355:x1877722797260160:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790736285.837126:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790736285.837134:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527600/0x6aae200528fe6e30 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527042 expref: 20 pid: 5843 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.837148:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527600/0x6aae200528fe6e30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527042 expref: 20 pid: 5843 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.837174:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527600/0x6aae200528fe6e30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527042 expref: 20 pid: 5843 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.837194:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94160678a400) 00010000:00010000:2.0:1790736285.837199:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6e6f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.837211:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6e6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.837220:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6e6f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736285.837261:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790736285.837322:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162fafd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+19:2355:x1877722797260160:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 249us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736285.837348:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 71 00010000:00010000:1.0:1790736285.837614:0:8114:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6e6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.837631:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6e6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790736285.837839:0:8114:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1790736285.838007:0:8114:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1790736285.838077:0:8114:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1790736285.838246:0:8114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941642040000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8114:1877722816130432:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1790736285.838688:0:8114:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736285.838993:0:8114:0:(client.c:2716:ptlrpc_set_wait()) set ffff941605768e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790736285.840665:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816130432 00000100:00100000:3.0:1790736285.840683:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816130432 00000100:00100000:0.0:1790736285.840929:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790736285.840942:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8114:x1877722816130432:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1790736285.841135:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8114:x1877722816130432:12345-0@lo:1000:mdt00_003.0 Request processed in 196us (2448us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736285.841144:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790736285.841240:0:8114:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1790736285.841249:0:8114:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94162fafc000, transno 4294967315 00000100:00100000:1.0:1790736285.841280:0:8114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941642040000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8114:1877722816130432:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1790736285.842635:0:8114:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1790736285.842745:0:8114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941642040000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8114:1877722816130560:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1790736285.842818:0:8114:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736285.843845:0:8114:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162a685780 going to sleep for 11 seconds 00000100:00100000:3.0:1790736285.843886:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816130560 00000100:00100000:3.0:1790736285.843901:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816130560 00000100:00100000:2.0:1790736285.844041:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790736285.844065:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8114:x1877722816130560:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1790736285.844690:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8114:x1877722816130560:12345-0@lo:1000:mdt00_003.0 Request processed in 636us (1868us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1790736285.844701:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790736285.844940:0:8114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941642040000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8114:1877722816130560:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1790736285.844998:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6e6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.845012:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6e6f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.845021:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6e6f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.845029:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c61800 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736285.845035:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6e6f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.848216:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6e6f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.848241:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94160678a400) 00010000:00010000:1.0:1790736285.848245:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790736285.848253:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6e6f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.848262:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe6e6f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.848309:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6da4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.848318:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6da4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.848325:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6da4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.848331:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c8e00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736285.848336:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6da4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.848342:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6da4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.848350:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94161505d900) 00010000:00010000:1.0:1790736285.848352:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790736285.848355:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6da4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.848374:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6da4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.850304:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe6e76 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.850341:0:8114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6dc0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527026 expref: 22 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.850353:0:8114:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe6e76 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.850431:0:8114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6dc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0x92962417a527026 expref: 22 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.850450:0:8114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6dc0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527026 expref: 22 pid: 5845 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736285.850596:0:8114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162fafc380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8114:1877722816130688:192.168.203.5@tcp:104: 00000100:00100000:0.0:1790736285.850737:0:8114:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416012549c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790736285.859581:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736285.859716:0:8114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162fafc380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8114:1877722816130688:192.168.203.5@tcp:104: 00010000:00010000:1.0:1790736285.859757:0:8114:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe6e76 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736285.860155:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797260288 00000100:00100000:3.0:1790736285.860167:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797260288 00010000:00010000:3.0:1790736285.860219:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6dc0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527026 expref: 23 pid: 5845 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736285.860265:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 72 00000100:00100000:3.0:1790736285.860285:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162fafea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+23:2355:x1877722797260288:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790736285.860305:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790736285.860313:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6dc0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527026 expref: 23 pid: 5845 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.860326:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6dc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527026 expref: 23 pid: 5845 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.860356:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6dc0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527026 expref: 23 pid: 5845 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.860384:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94161505d900) 00010000:00010000:3.0:1790736285.860390:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe6e76 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.860410:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe6e76 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.860419:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe6e76 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736285.860452:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790736285.860476:0:8114:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe6e76 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.860483:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe6e76 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.860499:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe6e76 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.860506:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe6e76 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.860514:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe6e76 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.860521:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9416013fe200 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736285.860527:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe6e76 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.860535:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe6e76 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.860545:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94161505d900) 00010000:00010000:1.0:1790736285.860554:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736285.860559:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe6e76 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.860567:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe6e76 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.860583:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe6e68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.860589:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe6e68 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.860595:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe6e68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.860600:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60200 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736285.860603:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe6e68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.860608:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe6e68 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.860616:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94161505d900) 00010000:00010000:1.0:1790736285.860618:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790736285.860620:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe6e68 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736285.860625:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe6e68 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736285.860767:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162fafea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+22:2355:x1877722797260288:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 484us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736285.860776:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 72 00000100:00100000:1.0:1790736285.860882:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162fafd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+21:11481:x1877722797260032:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 30143us (31981us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1790736285.860901:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 185 00000020:00080000:1.0:1790736285.860905:0:8114:0:(tgt_main.c:787:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1790736285.862697:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790736285.862710:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790736285.863283:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1790736285.863296:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790736285.864983:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736285.866032:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797260544 00000100:00100000:1.0:1790736285.866050:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797260544 00000100:00100000:1.0:1790736285.866162:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 50 00000100:00100000:1.0:1790736285.866175:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416114efc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+21:11481:x1877722797260544:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1790736285.870886:0:5847:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1790736285.871032:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1790736285.871870:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ffc00/0x6aae200528fe6e7d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.871897:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ffc00/0x6aae200528fe6e7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.871912:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ffc00/0x6aae200528fe6e7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.871922:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ffc00/0x6aae200528fe6e7d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.871928:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ffc00/0x6aae200528fe6e7d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.871935:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ffc00/0x6aae200528fe6e7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.871956:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790736285.872143:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416114efc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+23:11481:x1877722797260544:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 5963us (7166us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1790736285.872163:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 50 00000020:00080000:0.0:1790736285.872172:0:5847:0:(tgt_main.c:787:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790736285.872269:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790736285.872287:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ffc00/0x6aae200528fe6e7d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.872294:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9416013ffc00 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:0.0:1790736285.872299:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ffc00/0x6aae200528fe6e7d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.872308:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ffc00/0x6aae200528fe6e7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.872322:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff941605242c00) 00010000:00010000:0.0:1790736285.872325:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790736285.872330:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ffc00/0x6aae200528fe6e7d lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.872337:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ffc00/0x6aae200528fe6e7d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736285.872359:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736285.872360:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736285.872362:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790736285.895041:0:7658:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:2.0:1790736285.895066:0:7658:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00010000:00010000:0.0:1790736286.487078:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790736287.367412:0:12484:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790736287.367422:0:12484:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790736287.367469:0:12484:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1790736287.367474:0:12484:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1790736287.513633:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736287.546219:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736287.547607:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797260800 00000100:00100000:1.0:1790736287.547623:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797260800 00000100:00100000:1.0:1790736287.547705:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 186 00000100:00100000:1.0:1790736287.547719:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+23:11499:x1877722797260800:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1790736287.547747:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736287.547771:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6e84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a52705e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.547884:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6e8b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.547900:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6e8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.547912:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6e8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790736287.547944:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1790736287.548126:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6e84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52705e expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.548481:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6e8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52705e expref: 25 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.548492:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94161505de00) 00010000:00010000:1.0:1790736287.548495:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790736287.548499:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c60a00, rc 0) 00000100:00100000:1.0:1790736287.548572:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+25:11499:x1877722797260800:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 856us (2365us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1790736287.548580:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 186 00000100:00080000:3.0:1790736287.548800:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790736287.558431:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736287.558563:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797260928 00000100:00100000:1.0:1790736287.558577:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797260928 00000100:00100000:1.0:1790736287.558636:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 187 00000100:00100000:1.0:1790736287.558646:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f240e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+25:11499:x1877722797260928:12345-192.168.203.5@tcp:34:lfs.0 00010000:00010000:1.0:1790736287.558722:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6e99 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.558740:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6e99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.558753:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6e99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.558768:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6ea0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.558790:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.558798:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.559069:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6ea7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.559078:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.559085:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790736287.559161:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.559175:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6e99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.559182:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6e99 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.559189:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6e99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.559195:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60e00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736287.559199:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6e99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.559206:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6e99 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.559225:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94161505de00) 00010000:00010000:1.0:1790736287.559228:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736287.559234:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6e99 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.559241:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6e99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.559253:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.559258:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6ea0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.559264:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6ea0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.559268:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736287.559271:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6ea0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.559277:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6ea0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.559284:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff941603253300) 00010000:00010000:1.0:1790736287.559286:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736287.559288:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6ea0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.559293:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6ea0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.559320:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.559327:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6ea7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.559333:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6ea7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.559338:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60600 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736287.559341:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6ea7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.559346:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6ea7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.559352:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff941603253e00) 00010000:00010000:1.0:1790736287.559354:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736287.559357:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6ea7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.559361:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6ea7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736287.559587:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f240e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+25:11499:x1877722797260928:12345-192.168.203.5@tcp:34:lfs.0 Request processed in 940us (1161us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736287.559596:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 187 00000100:00100000:2.0:1790736287.633639:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736287.633774:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797261184 00000100:00100000:3.0:1790736287.633785:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797261184 00000100:00100000:3.0:1790736287.633845:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 188 00000100:00100000:3.0:1790736287.633854:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941502bfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+25:11502:x1877722797261184:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1790736287.633876:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736287.633896:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6eae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a527065 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736287.633990:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6eb5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736287.634006:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6eb5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736287.634019:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6eb5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736287.634035:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe6ebc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736287.634043:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe6ebc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736287.634049:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe6ebc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736287.634564:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6ec3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736287.634574:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736287.634581:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790736287.634590:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1790736287.634674:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6eb5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736287.634682:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6eb5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736287.634693:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6eb5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736287.634699:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c8e00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736287.634703:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6eb5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736287.634710:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6eb5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736287.634720:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94161505de00) 00010000:00010000:3.0:1790736287.634723:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736287.634727:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6eb5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736287.634733:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe6eb5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736287.634743:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe6ebc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736287.634748:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe6ebc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736287.634754:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe6ebc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736287.634759:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c9800 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736287.634762:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe6ebc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736287.634778:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe6ebc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736287.634787:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94161505dc00) 00010000:00010000:3.0:1790736287.634789:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736287.634792:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe6ebc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736287.634798:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe6ebc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736287.634838:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe6eae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527065 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736287.634850:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527065 expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736287.634856:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94161505d500) 00010000:00010000:3.0:1790736287.634858:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790736287.634860:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c9c00, rc 0) 00000100:00100000:3.0:1790736287.634932:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941502bfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+27:11502:x1877722797261184:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1078us (1305us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1790736287.634940:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 188 00000100:00100000:3.0:1790736287.638477:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736287.638562:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797261312 00000100:00100000:2.0:1790736287.638572:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797261312 00000100:00100000:2.0:1790736287.638665:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 189 00000100:00100000:2.0:1790736287.638676:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f243800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+27:11502:x1877722797261312:12345-192.168.203.5@tcp:54:lfs.0 00010000:00010000:2.0:1790736287.638744:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527400/0x6aae200528fe6ed1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736287.638760:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527400/0x6aae200528fe6ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736287.638771:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527400/0x6aae200528fe6ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736287.638794:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527400/0x6aae200528fe6ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736287.638800:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527400/0x6aae200528fe6ed1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736287.638821:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527400/0x6aae200528fe6ed1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736287.638826:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163c527400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736287.638830:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527400/0x6aae200528fe6ed1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736287.638837:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527400/0x6aae200528fe6ed1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736287.638848:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94161505d500) 00010000:00010000:2.0:1790736287.638850:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790736287.638854:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527400/0x6aae200528fe6ed1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736287.638860:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527400/0x6aae200528fe6ed1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736287.638933:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f243800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+27:11502:x1877722797261312:12345-192.168.203.5@tcp:54:lfs.0 Request processed in 259us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736287.638940:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 189 00000100:00100000:3.0:1790736287.642997:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736287.643037:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797261568 00000100:00100000:3.0:1790736287.643047:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797261568 00000100:00100000:3.0:1790736287.643124:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 51 00000100:00100000:3.0:1790736287.643148:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+27:11502:x1877722797261568:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:3.0:1790736287.643372:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+28:11502:x1877722797261568:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 225us (384us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1790736287.643379:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 51 00000100:00100000:3.0:1790736287.711226:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736287.711367:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797261824 00000100:00100000:0.0:1790736287.711376:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797261824 00000100:00100000:0.0:1790736287.711445:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 190 00000100:00100000:0.0:1790736287.711456:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633818000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+28:11027:x1877722797261824:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:0.0:1790736287.711485:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736287.711509:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff400/0x6aae200528fe6ed8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a52706c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.711623:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff800/0x6aae200528fe6edf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.711652:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6ec3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527065 expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.711661:0:5843:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff800/0x6aae200528fe6edf lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.711691:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0x92962417a527065 expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.711704:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6ec3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527065 expref: 29 pid: 5844 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736287.711717:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162fafe300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1877722816130816:192.168.203.5@tcp:104: 00000100:00100000:0.0:1790736287.711821:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff94161871a540 going to sleep for 11 seconds 00000100:00100000:1.0:1790736287.719319:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162fafe300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1877722816130816:192.168.203.5@tcp:104: 00010000:00010000:1.0:1790736287.719359:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff800/0x6aae200528fe6edf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736287.720026:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736287.720222:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797261952 00000100:00100000:2.0:1790736287.720230:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797261952 00010000:00010000:2.0:1790736287.720280:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6ec3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527065 expref: 30 pid: 5844 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736287.720314:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 73 00000100:00100000:2.0:1790736287.720324:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633819c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+30:2356:x1877722797261952:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790736287.720349:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790736287.720366:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6ec3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527065 expref: 30 pid: 5844 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736287.720378:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527065 expref: 30 pid: 5844 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736287.720410:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9c00/0x6aae200528fe6ec3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527065 expref: 30 pid: 5844 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736287.720429:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94161505d500) 00010000:00010000:2.0:1790736287.720434:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff800/0x6aae200528fe6edf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736287.720443:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff800/0x6aae200528fe6edf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736287.720450:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff800/0x6aae200528fe6edf lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736287.720479:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790736287.720539:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633819c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+29:2356:x1877722797261952:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 216us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736287.720547:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 73 00010000:00010000:1.0:1790736287.720817:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff800/0x6aae200528fe6edf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.720825:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff800/0x6aae200528fe6edf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790736287.720843:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1790736287.720993:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff400/0x6aae200528fe6ed8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52706c expref: 30 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.721010:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff800/0x6aae200528fe6edf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52706c expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.721017:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94161505d500) 00010000:00010000:1.0:1790736287.721020:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790736287.721022:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9416013ff800, rc 0) 00000100:00100000:1.0:1790736287.721065:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633818000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+29:11027:x1877722797261824:12345-192.168.203.5@tcp:101:bash.0 Request processed in 9611us (9850us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1790736287.721072:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 190 00000100:00100000:3.0:1790736287.726031:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736287.726164:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797262208 00000100:00100000:1.0:1790736287.726174:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797262208 00000100:00100000:1.0:1790736287.726227:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 191 00000100:00100000:1.0:1790736287.726237:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163381aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+29:11027:x1877722797262208:12345-192.168.203.5@tcp:36:bash.0 00010000:00010000:1.0:1790736287.726737:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6eed lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.726755:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6eed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.726782:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6eed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790736287.726841:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:1.0:1790736287.726868:0:5845:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000099d051bc reply state 000000004772e3cc transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6eed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736287.726876:0:5845:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1790736287.726925:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:1.0:1790736287.727037:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163381aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+33:11027:x1877722797262208:12345-192.168.203.5@tcp:36:bash.0 Request processed in 799us (1014us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1790736287.727046:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 191 00000020:00080000:1.0:1790736287.727054:0:5845:0:(tgt_main.c:787:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1790736287.728666:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6eed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.728680:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6eed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.728687:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6eed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.728693:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736287.728698:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6eed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.728705:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6eed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.728741:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94161505d500) 00010000:00010000:0.0:1790736287.728744:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736287.728749:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6eed lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.728919:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6eed lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736287.729536:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736287.731990:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797262336 00000100:00100000:1.0:1790736287.732006:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797262336 00000100:00100000:1.0:1790736287.732111:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 192 00000100:00100000:1.0:1790736287.732123:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160312e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+32:11027:x1877722797262336:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:1.0:1790736287.732148:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736287.732171:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6ef4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a527073 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.732235:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6ef4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527073 expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.733045:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6ef4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527073 expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.733079:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94161505d500) 00010000:00010000:1.0:1790736287.733156:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790736287.733161:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c60e00, rc 0) 00000100:00100000:1.0:1790736287.733253:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160312e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+33:11027:x1877722797262336:12345-192.168.203.5@tcp:101:bash.0 Request processed in 1131us (3722us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736287.733260:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 192 00000100:00100000:2.0:1790736287.746468:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736287.746574:0:8632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797262464 00000100:00100000:0.0:1790736287.746584:0:8632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797262464 00000100:00100000:0.0:1790736287.746678:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 58 00000100:00100000:0.0:1790736287.746689:0:8632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941502bfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+7:11027:x1877722797262464:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:0.0:1790736287.746708:0:8632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736287.746732:0:8632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083374fc2/0x6aae200528fe6efb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a52707a expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790736287.746759:0:8632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6abc779c, atime: 0x6abc779b, ctime: 0x6abc779c, blocks: 0xb 00010000:00010000:0.0:1790736287.746782:0:8632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=359s v=(0 0) 00010000:00010000:0.0:1790736287.746787:0:8632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736287.746795:0:8632:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083374fc2/0x6aae200528fe6efb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.5@tcp remote: 0x92962417a52707a expref: 8 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.746812:0:8632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000083374fc2/0x6aae200528fe6efb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.5@tcp remote: 0x92962417a52707a expref: 8 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.746825:0:8632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9416013ffc00, rc 0) 00000100:00100000:0.0:1790736287.746899:0:8632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941502bfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+8:11027:x1877722797262464:12345-192.168.203.5@tcp:101:bash.0 Request processed in 212us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736287.746923:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 58 00000100:00080000:3.0:1790736287.746997:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790736287.751200:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736287.751347:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797262592 00000100:00100000:2.0:1790736287.751358:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797262592 00002000:00010000:2.0:1790736287.751423:0:6705:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1790736287.751429:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94160312df80 with x1877722797262592 ext(0->18446744073709551615) 00002000:00010000:2.0:1790736287.751441:0:6705:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94160312df80. 00000100:00100000:2.0:1790736287.751466:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 5 00000100:00100000:2.0:1790736287.751491:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160312df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+8:2356:x1877722797262592:12345-192.168.203.5@tcp:10:bash.0 00002000:00010000:2.0:1790736287.751765:0:6705:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1790736287.751769:0:6705:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1790736284 -> 1790736288 00002000:00010000:2.0:1790736287.751772:0:6705:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1790736283 -> 1790736283 00002000:00010000:2.0:1790736287.751775:0:6705:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1790736284 -> 1790736288 00002000:00010000:2.0:1790736287.751777:0:6705:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1790736287.751848:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160312df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+9:2356:x1877722797262592:12345-192.168.203.5@tcp:10:bash.0 Request processed in 359us (659us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1790736287.751856:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 5 00002000:00010000:2.0:1790736287.751860:0:6705:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1790736287.751862:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94160312df80 with x1877722797262592 ext(0->18446744073709551615) 00002000:00010000:2.0:1790736287.751868:0:6705:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94160312df80. 00000100:00100000:2.0:1790736287.865916:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736287.866013:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797262720 00000100:00100000:1.0:1790736287.866024:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797262720 00000100:00100000:1.0:1790736287.866087:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 193 00000100:00100000:1.0:1790736287.866135:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941502bfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+33:11516:x1877722797262720:12345-192.168.203.5@tcp:34:lfs.0 00010000:00010000:1.0:1790736287.866209:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6f02 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.866226:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6f02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.866237:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6f02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.866413:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6f09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.866421:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6f09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.866428:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6f09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.866662:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6f10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.866672:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6f10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.866688:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6f10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790736287.866727:0:8114:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6f10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.866739:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6f02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.866746:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6f02 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.866754:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6f02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.866760:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c61400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736287.866765:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6f02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.866772:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6f02 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.866784:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94161505de00) 00010000:00010000:1.0:1790736287.866787:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736287.866791:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6f02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.866797:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6f02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.866809:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6f09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.866821:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6f09 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.866827:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6f09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.866833:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736287.866836:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6f09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.866842:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6f09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.866850:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff941603253e00) 00010000:00010000:1.0:1790736287.866852:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736287.866854:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6f09 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.866860:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6f09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.866874:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6f10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.866879:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6f10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.866884:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6f10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.866888:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736287.866897:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6f10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.866903:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6f10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.866910:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94161505d500) 00010000:00010000:1.0:1790736287.866912:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736287.866915:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6f10 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.866921:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6f10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736287.866998:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941502bfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+33:11516:x1877722797262720:12345-192.168.203.5@tcp:34:lfs.0 Request processed in 866us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736287.867007:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 193 00000100:00100000:3.0:1790736287.924621:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736287.924819:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797262976 00000100:00100000:0.0:1790736287.924834:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797262976 00000100:00100000:0.0:1790736287.924922:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 194 00000100:00100000:0.0:1790736287.924934:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160312c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+33:11519:x1877722797262976:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1790736287.924964:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736287.924992:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe400/0x6aae200528fe6f17 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a527081 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.925144:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe6f1e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.925163:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe6f1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.925179:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe6f1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.925198:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff400/0x6aae200528fe6f25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.925206:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff400/0x6aae200528fe6f25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.925212:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff400/0x6aae200528fe6f25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.925791:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6f2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.925816:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6f2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.925824:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6f2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790736287.925837:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1790736287.926750:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe6f1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.926768:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe6f1e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.926777:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe6f1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.926784:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9416013fe200 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736287.926789:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe6f1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.926808:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe6f1e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.926826:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94161505de00) 00010000:00010000:0.0:1790736287.926829:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736287.926836:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe6f1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.928117:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe6f1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.928148:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff400/0x6aae200528fe6f25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.928175:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff400/0x6aae200528fe6f25 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.928182:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff400/0x6aae200528fe6f25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.928188:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9416013ff400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736287.928192:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff400/0x6aae200528fe6f25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.928200:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff400/0x6aae200528fe6f25 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.928216:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff941605242700) 00010000:00010000:0.0:1790736287.928219:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736287.928223:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff400/0x6aae200528fe6f25 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.928230:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff400/0x6aae200528fe6f25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.928963:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe400/0x6aae200528fe6f17 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527081 expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.928991:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6f2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527081 expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.929002:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94161505d500) 00010000:00010000:0.0:1790736287.929005:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790736287.929020:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941642172200, rc 0) 00000100:00100000:0.0:1790736287.931813:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160312c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+35:11519:x1877722797262976:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 6861us (7187us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1790736287.931843:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 194 00000100:00100000:3.0:1790736287.944617:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736287.944741:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797263104 00000100:00100000:0.0:1790736287.944755:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797263104 00000100:00100000:0.0:1790736287.944899:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 195 00000100:00100000:0.0:1790736287.944913:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160312d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+35:11519:x1877722797263104:12345-192.168.203.5@tcp:54:lfs.0 00010000:00010000:0.0:1790736287.945011:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe6f3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.945034:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff800/0x6aae200528fe6edf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52706c expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.945047:0:5845:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe6f3a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.945141:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff800/0x6aae200528fe6edf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0x92962417a52706c expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.945158:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff800/0x6aae200528fe6edf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a52706c expref: 35 pid: 5843 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736287.945181:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162faff800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1877722816130944:192.168.203.5@tcp:104: 00000100:00100000:0.0:1790736287.945314:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff94161871a540 going to sleep for 11 seconds 00000100:00100000:0.0:1790736287.948830:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162faff800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1877722816130944:192.168.203.5@tcp:104: 00010000:00010000:0.0:1790736287.948878:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe6f3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736287.950760:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736287.950956:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797263360 00000100:00100000:0.0:1790736287.950969:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797263360 00000100:00100000:0.0:1790736287.951050:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 52 00000100:00100000:0.0:1790736287.951062:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160838c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+36:5593:x1877722797263360:12345-192.168.203.5@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1790736287.954446:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160838c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+37:5593:x1877722797263360:12345-192.168.203.5@tcp:35:ldlm_bl.0 Request processed in 3370us (3680us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1790736287.954463:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 52 00000100:00100000:3.0:1790736287.963515:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736287.968681:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797263488 00000100:00100000:0.0:1790736287.968703:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797263488 00010000:00010000:1.0:1790736287.969197:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff800/0x6aae200528fe6edf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a52706c expref: 37 pid: 5843 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736287.969312:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 74 00000100:00100000:1.0:1790736287.969326:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160838e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+37:2355:x1877722797263488:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790736287.969349:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736287.969357:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff800/0x6aae200528fe6edf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a52706c expref: 37 pid: 5843 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.969372:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff800/0x6aae200528fe6edf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a52706c expref: 37 pid: 5843 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.969418:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff800/0x6aae200528fe6edf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0x92962417a52706c expref: 37 pid: 5843 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.969465:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94161505d500) 00010000:00010000:1.0:1790736287.969471:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe6f3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.969482:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe6f3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.969491:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe6f3a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736287.969527:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790736287.969624:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160838e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+36:2355:x1877722797263488:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 300us (6470us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736287.969633:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 74 00010000:00010000:0.0:1790736287.970437:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe6f3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.970452:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe6f3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.970494:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe6f3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.970502:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe6f3a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.970510:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe6f3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.970517:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642173200 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736287.970522:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe6f3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.970529:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe6f3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.970556:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94161505d500) 00010000:00010000:0.0:1790736287.970559:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790736287.970565:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe6f3a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736287.970572:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe6f3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736287.970652:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160312d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+35:11519:x1877722797263104:12345-192.168.203.5@tcp:54:lfs.0 Request processed in 25741us (26192us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736287.970663:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 195 00000100:00100000:3.0:1790736287.973747:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736287.973904:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797263744 00000100:00100000:0.0:1790736287.973916:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797263744 00000100:00100000:0.0:1790736287.974126:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 53 00000100:00100000:0.0:1790736287.974139:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160838ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+35:11519:x1877722797263744:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:1.0:1790736287.976238:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160838ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+36:11519:x1877722797263744:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 2084us (2486us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1790736287.976256:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 53 00000100:00100000:2.0:1790736288.054010:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736288.054195:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797264000 00000100:00100000:1.0:1790736288.054208:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797264000 00000100:00100000:1.0:1790736288.054468:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 196 00000100:00100000:1.0:1790736288.054482:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941502bff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+36:11530:x1877722797264000:12345-192.168.203.5@tcp:101:cat.0 00010000:00010000:1.0:1790736288.054530:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736288.054559:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6f41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a527088 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.054664:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6f48 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.054704:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6f48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.054720:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6f48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.054739:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6f4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.054747:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6f4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.054755:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6f4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.055131:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6f56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.055143:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6f56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.055151:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6f56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790736288.055162:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1790736288.055291:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6f48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.055301:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6f48 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.055308:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6f48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.055321:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736288.055327:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6f48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.055346:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6f48 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.055361:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94161505de00) 00010000:00010000:1.0:1790736288.055364:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736288.055370:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6f48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.055378:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6f48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.055401:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6f4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.055408:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6f4f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.055414:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6f4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.055420:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c61400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736288.055422:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6f4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.055429:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6f4f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.055448:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff941603253e00) 00010000:00010000:1.0:1790736288.055451:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736288.055454:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6f4f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.055461:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6f4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.055515:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6f41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527088 expref: 39 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.055530:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6f56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527088 expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.055538:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94161505d500) 00010000:00010000:1.0:1790736288.055541:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790736288.055543:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c60600, rc 0) 00000100:00100000:1.0:1790736288.055632:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941502bff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+38:11530:x1877722797264000:12345-192.168.203.5@tcp:101:cat.0 Request processed in 1154us (1638us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1790736288.055641:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 196 00000100:00100000:2.0:1790736288.061874:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736288.062009:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797264256 00000100:00100000:1.0:1790736288.062025:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797264256 00000100:00100000:1.0:1790736288.062144:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 54 00000100:00100000:1.0:1790736288.062156:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941502bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+38:11530:x1877722797264256:12345-192.168.203.5@tcp:35:cat.0 00000100:00100000:1.0:1790736288.062565:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941502bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+39:11530:x1877722797264256:12345-192.168.203.5@tcp:35:cat.0 Request processed in 409us (704us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1790736288.062576:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 54 00000100:00100000:3.0:1790736288.079945:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736288.082286:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797264512 00000100:00100000:1.0:1790736288.082306:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797264512 00000100:00100000:1.0:1790736288.082409:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 197 00000100:00100000:1.0:1790736288.082421:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160838d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+39:11531:x1877722797264512:12345-192.168.203.5@tcp:36:rm.0 00010000:00010000:1.0:1790736288.082520:0:8114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1790736288.082558:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6f56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527088 expref: 39 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.082719:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6f2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527081 expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.082745:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe6ef4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527073 expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.082757:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94161505d500) 00010000:00010000:1.0:1790736288.082772:0:8114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790736288.082800:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6f64 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.082873:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6f64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.082886:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6f64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.082905:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6f6b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.082914:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6f6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.082952:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6f6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.083578:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6f72 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.083589:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6f72 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.085927:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6f72 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790736288.088377:0:8114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1790736288.088405:0:8114:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 360099310062ns, next at 361099305322ns, rc = 0 00010000:00010000:1.0:1790736288.091221:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6f79 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.091261:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6f79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.091279:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6f79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.091291:0:8114:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6f79 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.091299:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6f79 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.091306:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6f79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.091360:0:8114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790736288.091784:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790736288.091795:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6f79 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.091805:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60800 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:0.0:1790736288.091809:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6f79 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.091832:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6f79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.091849:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff941603253300) 00010000:00010000:0.0:1790736288.091853:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790736288.091867:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6f79 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.091875:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60800/0x6aae200528fe6f79 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.091898:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736288.091900:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736288.091902:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736288.091960:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6f72 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.091969:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6f72 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.091975:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6f72 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.091982:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736288.091988:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6f72 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.091995:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6f72 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.092004:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff941603253300) 00010000:00010000:1.0:1790736288.092007:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1790736288.092011:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6f72 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.092018:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe6f72 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.092054:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6f64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.092061:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6f64 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.092067:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6f64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.092081:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736288.092084:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6f64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.092137:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6f64 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.092149:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94161505de00) 00010000:00010000:1.0:1790736288.092152:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736288.092156:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6f64 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.092163:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe6f64 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790736288.092177:0:8114:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000616e732e reply state 00000000e8df47ba transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6f6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736288.092190:0:8114:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790736288.092342:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160838d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+38:11531:x1877722797264512:12345-192.168.203.5@tcp:36:rm.0 Request processed in 9917us (12406us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1790736288.092353:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 197 00010000:00010000:0.0:1790736288.094852:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6f6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.094873:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6f6b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.094882:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6f6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.094888:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c61400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736288.094893:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6f6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.094901:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6f6b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.094923:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff941603253e00) 00010000:00010000:0.0:1790736288.094926:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736288.094931:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6f6b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.094948:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61400/0x6aae200528fe6f6b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736288.159336:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736288.159862:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797264768 00000100:00100000:0.0:1790736288.159876:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797264768 00000100:00100000:0.0:1790736288.159959:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 198 00000100:00100000:0.0:1790736288.159971:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+37:11537:x1877722797264768:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:0.0:1790736288.160008:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736288.160037:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe6f80 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a52708f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.160250:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6f87 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.160271:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6f87 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.160285:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6f87 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.160304:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6f8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.160312:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6f8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.160319:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6f8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790736288.161082:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1790736288.161373:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6f95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.161411:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.161423:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.161470:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6f87 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.161479:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6f87 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.161488:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6f87 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.161495:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642173c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736288.161510:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6f87 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.161519:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6f87 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.161533:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94161505de00) 00010000:00010000:0.0:1790736288.161537:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736288.161545:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6f87 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.161552:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe6f87 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790736288.161569:0:5843:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d5808937 reply state 000000002609510c transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6f8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736288.161587:0:5843:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790736288.161629:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe6f80 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52708f expref: 40 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.161646:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6f95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52708f expref: 39 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.161654:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff941605242500) 00010000:00010000:0.0:1790736288.161656:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790736288.161659:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941642172200, rc 0) 00000100:00100000:0.0:1790736288.161753:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+40:11537:x1877722797264768:12345-192.168.203.5@tcp:101:bash.0 Request processed in 1784us (2436us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1790736288.161762:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 198 00010000:00010000:1.0:1790736288.163989:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6f8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.164017:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6f8e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.164027:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6f8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.164059:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642173e00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736288.164065:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6f8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.164074:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6f8e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.164115:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff941605242700) 00010000:00010000:1.0:1790736288.164120:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736288.164126:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6f8e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.164134:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe6f8e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736288.166229:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736288.166566:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797264896 00000100:00100000:0.0:1790736288.166579:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797264896 00000100:00100000:0.0:1790736288.166669:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 59 00000100:00100000:0.0:1790736288.166681:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2355:x1877722797264896:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:0.0:1790736288.166707:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736288.166735:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000222980e2/0x6aae200528fe6fa3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a527096 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790736288.166770:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790736288.166796:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=360s v=(0 0) 00010000:00010000:0.0:1790736288.166801:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736288.166813:0:6698:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000222980e2/0x6aae200528fe6fa3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527096 expref: 6 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.166859:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000222980e2/0x6aae200528fe6fa3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527096 expref: 6 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.166875:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9416013ff800, rc 0) 00000100:00080000:3.0:1790736288.167021:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790736288.167064:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2355:x1877722797264896:12345-192.168.203.5@tcp:101:bash.0 Request processed in 384us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736288.167073:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 59 00000100:00100000:0.0:1790736288.171513:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736288.171620:0:8632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797265024 00000100:00100000:2.0:1790736288.171633:0:8632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797265024 00000100:00100000:2.0:1790736288.171736:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 60 00000100:00100000:2.0:1790736288.171749:0:8632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162faff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+6:11537:x1877722797265024:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:2.0:1790736288.171775:0:8632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736288.171802:0:8632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000264d0181/0x6aae200528fe6faa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a52709d expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.171844:0:8632:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000222980e2/0x6aae200528fe6fa3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527096 expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.171874:0:8632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790736288.171880:0:8632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790736288.171887:0:8632:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000264d0181/0x6aae200528fe6faa lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52709d expref: 7 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.171931:0:8632:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000222980e2/0x6aae200528fe6fa3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0x92962417a527096 expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.171948:0:8632:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000222980e2/0x6aae200528fe6fa3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527096 expref: 7 pid: 6698 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736288.171966:0:8632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941502bff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8632:1877722816131072:192.168.203.5@tcp:104: 00000100:00100000:2.0:1790736288.172085:0:8632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416112c1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790736288.189555:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736288.189695:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797265152 00000100:00100000:3.0:1790736288.189709:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797265152 00010000:00010000:3.0:1790736288.189767:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000222980e2/0x6aae200528fe6fa3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527096 expref: 8 pid: 6698 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736288.189869:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 75 00000100:00100000:3.0:1790736288.189883:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+8:2356:x1877722797265152:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790736288.189904:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790736288.189984:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000222980e2/0x6aae200528fe6fa3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527096 expref: 8 pid: 6698 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736288.190001:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000222980e2/0x6aae200528fe6fa3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527096 expref: 8 pid: 6698 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736288.190046:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790736288.190051:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790736288.190063:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000264d0181/0x6aae200528fe6faa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52709d expref: 8 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736288.190074:0:5828:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000264d0181/0x6aae200528fe6faa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52709d expref: 8 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736288.190151:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000264d0181/0x6aae200528fe6faa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52709d expref: 8 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736288.190170:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b6c4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5828:1877722816131200:192.168.203.5@tcp:105: 00000100:00100000:3.0:1790736288.190301:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416121786c0 going to sleep for 11 seconds 00010000:00010000:0.0:1790736288.192171:0:8632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000222980e2/0x6aae200528fe6fa3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527096 expref: 8 pid: 6698 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736288.192205:0:8632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941502bff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8632:1877722816131072:192.168.203.5@tcp:104: 00010000:00010000:0.0:1790736288.192246:0:8632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000264d0181/0x6aae200528fe6faa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0x92962417a52709d expref: 7 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.192265:0:8632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94163c526800, rc 0) 00000100:00100000:0.0:1790736288.192356:0:8632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162faff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+7:11537:x1877722797265024:12345-192.168.203.5@tcp:101:bash.0 Request processed in 20610us (20859us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736288.192367:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 60 00000100:00100000:2.0:1790736288.203924:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736288.204046:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797265408 00000100:00100000:1.0:1790736288.204062:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797265408 00000100:00100000:1.0:1790736288.204172:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 55 00000100:00100000:1.0:1790736288.204185:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+39:11537:x1877722797265408:12345-192.168.203.5@tcp:35:bash.0 00000100:00100000:1.0:1790736288.204909:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+40:11537:x1877722797265408:12345-192.168.203.5@tcp:35:bash.0 Request processed in 722us (995us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1790736288.204919:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 55 00000100:00100000:3.0:1790736288.205041:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b6c4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5828:1877722816131200:192.168.203.5@tcp:105: 00010000:00010000:3.0:1790736288.205074:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790736288.205137:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2356:x1877722797265152:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 15258us (15597us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736288.205147:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 75 00000100:00100000:2.0:1790736288.422008:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736288.422188:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797265536 00000100:00100000:0.0:1790736288.422202:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797265536 00000100:00100000:0.0:1790736288.422286:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 199 00000100:00100000:0.0:1790736288.422298:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+40:11553:x1877722797265536:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1790736288.422364:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736288.422400:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff800/0x6aae200528fe6fb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a5270a4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.422491:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff400/0x6aae200528fe6fb8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.422510:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff400/0x6aae200528fe6fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.422524:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff400/0x6aae200528fe6fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790736288.422570:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1790736288.422575:0:5845:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790736288.422597:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff400/0x6aae200528fe6fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.422626:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff800/0x6aae200528fe6fb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270a4 expref: 42 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.422650:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff400/0x6aae200528fe6fb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270a4 expref: 41 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.422660:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94161505de00) 00010000:00010000:0.0:1790736288.422663:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790736288.422667:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9416013ff400, rc 0) 00000100:00100000:0.0:1790736288.422753:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+41:11553:x1877722797265536:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 456us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736288.422761:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 199 00000100:00100000:0.0:1790736288.427223:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736288.427507:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797265792 00000100:00100000:2.0:1790736288.427522:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797265792 00000100:00100000:2.0:1790736288.427600:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 200 00000100:00100000:2.0:1790736288.427613:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162fafed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+41:11553:x1877722797265792:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1790736288.427645:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736288.427676:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526200/0x6aae200528fe6fbf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a5270ab expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.427883:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527600/0x6aae200528fe6fc6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.427923:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527600/0x6aae200528fe6fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.427937:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527600/0x6aae200528fe6fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790736288.427954:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1790736288.428246:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526200/0x6aae200528fe6fbf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270ab expref: 44 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.428269:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527600/0x6aae200528fe6fc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270ab expref: 43 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.428280:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff941605242500) 00010000:00010000:2.0:1790736288.428283:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790736288.428287:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94163c527600, rc 0) 00000100:00100000:2.0:1790736288.428496:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162fafed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+43:11553:x1877722797265792:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 885us (1287us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1790736288.428505:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 200 00000100:00100000:3.0:1790736288.432577:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736288.432930:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797265920 00000100:00100000:0.0:1790736288.432944:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797265920 00000100:00100000:3.0:1790736288.433040:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736288.433050:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 14 00000100:00100000:0.0:1790736288.433065:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160557f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+43:2355:x1877722797265920:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790736288.433089:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790736288.433151:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527600/0x6aae200528fe6fc6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270ab expref: 43 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.433172:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff941605242500) 00010000:00010000:0.0:1790736288.433177:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790736288.433252:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797266176 00000100:00100000:0.0:1790736288.433257:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160557f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+42:2355:x1877722797265920:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 196us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736288.433260:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797266176 00000100:00100000:0.0:1790736288.433270:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 14 00000100:00100000:2.0:1790736288.433304:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 201 00000100:00100000:2.0:1790736288.433316:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+42:11553:x1877722797266176:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1790736288.433422:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736288.433445:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526000/0x6aae200528fe6fd4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a5270b2 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.433601:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527200/0x6aae200528fe6fdb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.433620:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527200/0x6aae200528fe6fdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.433634:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527200/0x6aae200528fe6fdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790736288.433651:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1790736288.434206:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526000/0x6aae200528fe6fd4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270b2 expref: 45 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.434228:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527200/0x6aae200528fe6fdb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270b2 expref: 44 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.434296:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff941605242500) 00010000:00010000:2.0:1790736288.434300:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790736288.434303:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94163c527200, rc 0) 00000100:00100000:2.0:1790736288.434654:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+44:11553:x1877722797266176:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1339us (1616us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1790736288.434663:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 201 00000100:00100000:3.0:1790736288.451665:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736288.452138:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797266304 00000100:00100000:0.0:1790736288.452152:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797266304 00000100:00100000:0.0:1790736288.452229:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 61 00000100:00100000:0.0:1790736288.452241:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+6:2356:x1877722797266304:12345-192.168.203.5@tcp:1:lfs.0 00010000:00010000:0.0:1790736288.452299:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000222980e2/0x6aae200528fe6fe9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.452325:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000264d0181/0x6aae200528fe6faa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0x92962417a52709d expref: 6 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.452334:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736288.452339:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790736288.452344:0:6698:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000222980e2/0x6aae200528fe6fe9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.452418:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000264d0181/0x6aae200528fe6faa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.5@tcp remote: 0x92962417a52709d expref: 6 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.452435:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000264d0181/0x6aae200528fe6faa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a52709d expref: 6 pid: 8632 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736288.452756:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162fafc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6698:1877722816131328:192.168.203.5@tcp:104: 00000100:00100000:0.0:1790736288.453193:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611ff40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790736288.455609:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162fafc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6698:1877722816131328:192.168.203.5@tcp:104: 00010000:00010000:0.0:1790736288.455762:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000222980e2/0x6aae200528fe6fe9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736288.457483:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736288.457580:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797266432 00000100:00100000:2.0:1790736288.457593:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797266432 00002000:00100000:2.0:1790736288.457673:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff94163b6c5180 x1877722797266432/t0(0) o4->f945944d-9086-46a2-a91c-8bc7b88e8918@192.168.203.5@tcp:119/0 lens 504/0 e 0 to 0 dl 1790736299 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790736288.457686:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94163b6c5180 with x1877722797266432 ext(0->8) 00010000:00010000:2.0:1790736288.457716:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000264d0181/0x6aae200528fe6faa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a52709d expref: 7 pid: 8632 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.457735:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000264d0181/0x6aae200528fe6faa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a52709d expref: 7 pid: 8632 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790736288.457744:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff94163b6c5180 00000100:00100000:2.0:1790736288.457789:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3 00000100:00100000:2.0:1790736288.457800:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+7:2355:x1877722797266432:12345-192.168.203.5@tcp:4:lfs.0 00000100:00100000:2.0:1790736288.458643:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+9:2355:x1877722797266432:12345-192.168.203.5@tcp:4:lfs.0 Request processed in 838us (1164us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1790736288.458656:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3 00002000:00100000:2.0:1790736288.458688:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff94163b6c5180 x1877722797266432/t4294967308(0) o4->f945944d-9086-46a2-a91c-8bc7b88e8918@192.168.203.5@tcp:119/0 lens 504/448 e 0 to 0 dl 1790736299 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790736288.458704:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94163b6c5180 with x1877722797266432 ext(0->8) 00010000:00010000:2.0:1790736288.458715:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000264d0181/0x6aae200528fe6faa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a52709d expref: 9 pid: 8632 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.458735:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000264d0181/0x6aae200528fe6faa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a52709d expref: 9 pid: 8632 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790736288.458742:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff94163b6c5180 00000100:00100000:3.0:1790736288.461559:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736288.462827:0:8527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797266560 00000100:00100000:2.0:1790736288.462841:0:8527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797266560 00010000:00010000:2.0:1790736288.462914:0:8527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000264d0181/0x6aae200528fe6faa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a52709d expref: 9 pid: 8632 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736288.462999:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 76 00000100:00100000:2.0:1790736288.463012:0:8527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+9:2356:x1877722797266560:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790736288.463032:0:8527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1790736288.463336:0:8527:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1790736288.463340:0:8527:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1790736288 00002000:00010000:2.0:1790736288.463343:0:8527:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1790736288 00002000:00010000:2.0:1790736288.463345:0:8527:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1790736288 00010000:00010000:2.0:1790736288.463353:0:8527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000264d0181/0x6aae200528fe6faa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a52709d expref: 9 pid: 8632 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.463368:0:8527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000264d0181/0x6aae200528fe6faa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a52709d expref: 9 pid: 8632 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.463407:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000264d0181/0x6aae200528fe6faa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.5@tcp remote: 0x92962417a52709d expref: 9 pid: 8632 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.463429:0:8527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790736288.463437:0:8527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790736288.463445:0:8527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000222980e2/0x6aae200528fe6fe9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.463457:0:8527:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000222980e2/0x6aae200528fe6fe9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.463565:0:8527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790736288.463664:0:8527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+8:2356:x1877722797266560:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 654us (2118us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736288.463674:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 76 00010000:00010000:0.0:1790736288.464656:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000222980e2/0x6aae200528fe6fe9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.464673:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000222980e2/0x6aae200528fe6fe9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.464717:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000222980e2/0x6aae200528fe6fe9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.464727:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000222980e2/0x6aae200528fe6fe9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.464759:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000222980e2/0x6aae200528fe6fe9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.464766:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9416013ff800 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:0.0:1790736288.464772:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000222980e2/0x6aae200528fe6fe9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.464783:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000222980e2/0x6aae200528fe6fe9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.464801:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000222980e2/0x6aae200528fe6fe9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.464809:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000222980e2/0x6aae200528fe6fe9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736288.464959:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+7:2356:x1877722797266304:12345-192.168.203.5@tcp:1:lfs.0 Request processed in 12716us (13304us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736288.464969:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 61 00000100:00100000:3.0:1790736288.467636:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736288.467730:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797266816 00000100:00100000:2.0:1790736288.467743:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797266816 00000100:00100000:2.0:1790736288.467810:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 56 00000100:00100000:2.0:1790736288.467822:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416114ecc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+44:11553:x1877722797266816:12345-192.168.203.5@tcp:35:lfs.0 00000004:00010000:2.0:1790736288.467909:0:5846:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527200/0x6aae200528fe6fdb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270b2 expref: 44 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790736288.468740:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1790736288.468805:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1790736288.469662:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1790736288.469744:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6ff0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.469768:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6f95 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52708f expref: 48 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.469779:0:5846:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6ff0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.469838:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6f95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0x92962417a52708f expref: 48 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.469857:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6f95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a52708f expref: 48 pid: 5843 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736288.469876:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b308380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5846:1877722816131456:192.168.203.5@tcp:104: 00000100:00100000:2.0:1790736288.470019:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416112c1300 going to sleep for 11 seconds 00000100:00100000:3.0:1790736288.474058:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736288.474193:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797266944 00000100:00100000:0.0:1790736288.474207:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797266944 00010000:00010000:0.0:1790736288.474274:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6f95 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a52708f expref: 49 pid: 5843 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736288.474323:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 77 00000100:00100000:0.0:1790736288.474363:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ad1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+49:2356:x1877722797266944:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790736288.474392:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790736288.474407:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6f95 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a52708f expref: 49 pid: 5843 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.474424:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6f95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a52708f expref: 49 pid: 5843 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.474453:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff941605242500) 00010000:00010000:0.0:1790736288.474460:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6ff0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.474472:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6ff0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.474480:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6ff0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.474504:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790736288.474577:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ad1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+49:2356:x1877722797266944:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 215us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736288.474586:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 77 00010000:00010000:2.0:1790736288.476189:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe6f95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0x92962417a52708f expref: 48 pid: 5843 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736288.476220:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b308380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5846:1877722816131456:192.168.203.5@tcp:104: 00010000:00010000:2.0:1790736288.476310:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6ff0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.476321:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6ff0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.476327:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6ff0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790736288.476613:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1790736288.476881:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1790736288.477019:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b308380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1877722816131584:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1790736288.477313:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736288.477369:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416112c1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790736288.477608:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816131584 00000100:00100000:3.0:1790736288.477617:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816131584 00000100:00100000:3.0:1790736288.477709:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790736288.477721:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b309880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1877722816131584:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1790736288.477819:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b309880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1877722816131584:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 101us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736288.477827:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1790736288.477938:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790736288.477969:0:5846:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:2.0:1790736288.477976:0:5846:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:2.0:1790736288.478000:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94162fafdf80, transno 4294967307 00000100:00100000:2.0:1790736288.478023:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b308380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1877722816131584:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1790736288.479543:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1790736288.479636:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b308380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1877722816131712:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1790736288.479711:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736288.479755:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416112c1300 going to sleep for 11 seconds 00000100:00100000:3.0:1790736288.479920:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816131712 00000100:00100000:3.0:1790736288.479929:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816131712 00000100:00100000:3.0:1790736288.479987:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790736288.479998:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1877722816131712:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1790736288.480526:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1877722816131712:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 527us (812us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1790736288.480536:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790736288.480668:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b308380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1877722816131712:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1790736288.480745:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1790736288.480797:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6ff0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.480809:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6ff0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.480818:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6ff0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.480825:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163c526800 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736288.480831:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6ff0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.480839:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6ff0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.480858:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff941605242500) 00010000:00010000:2.0:1790736288.480862:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1790736288.480868:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6ff0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.480876:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526800/0x6aae200528fe6ff0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790736288.481135:0:5846:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1790736288.481689:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1790736288.481705:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 360492610967ns, next at 361492607656ns, rc = 0 00000001:00080000:2.0:1790736288.481714:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1790736288.481757:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff941605242500) 00010000:00010000:2.0:1790736288.481775:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790736288.481785:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527200/0x6aae200528fe6fdb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270b2 expref: 52 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736288.481970:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416114ecc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+51:11553:x1877722797266816:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 14149us (14346us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1790736288.481981:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 56 00000020:00080000:2.0:1790736288.481986:0:5846:0:(tgt_main.c:787:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1790736288.484833:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736288.484957:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797267072 00000100:00100000:1.0:1790736288.484968:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797267072 00000100:00100000:1.0:1790736288.485060:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 202 00000100:00100000:1.0:1790736288.485072:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ad18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+51:11553:x1877722797267072:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1790736288.485138:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736288.485188:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6ff7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a5270b9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.485631:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6ff7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270b9 expref: 52 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.485651:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6ff7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270b9 expref: 52 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.485675:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff941603253300) 00010000:00010000:1.0:1790736288.485678:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790736288.485683:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c60600, rc 0) 00000100:00100000:1.0:1790736288.485770:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ad18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+52:11553:x1877722797267072:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 687us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736288.485778:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 202 00000100:00100000:1.0:1790736288.489186:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736288.489338:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797267328 00000100:00100000:3.0:1790736288.489360:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797267328 00000100:00100000:3.0:1790736288.489438:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 57 00000100:00100000:3.0:1790736288.489450:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+52:11553:x1877722797267328:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:3.0:1790736288.489772:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+53:11553:x1877722797267328:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 322us (598us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1790736288.489781:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 57 00010000:00010000:0.0:1790736288.539241:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736288.571262:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736288.571603:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797267456 00000100:00100000:1.0:1790736288.571616:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797267456 00000100:00100000:1.0:1790736288.571708:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 203 00000100:00100000:1.0:1790736288.571721:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ad18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+53:11563:x1877722797267456:12345-192.168.203.5@tcp:34:lfs.0 00010000:00010000:1.0:1790736288.571840:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6ffe lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.571876:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6ffe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.571892:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6ffe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.571937:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7005 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.571945:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7005 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.571951:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7005 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.572084:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe700c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.572131:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe700c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.572139:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe700c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790736288.572199:0:8114:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe700c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.572215:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6ffe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.572222:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6ffe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.572228:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6ffe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.572248:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c61c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736288.572254:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6ffe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.572272:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6ffe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.572287:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94161505de00) 00010000:00010000:1.0:1790736288.572290:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736288.572296:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6ffe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.572302:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe6ffe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.572319:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7005 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.572326:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7005 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.572337:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7005 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.573584:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c61800 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736288.573592:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7005 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.573603:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7005 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.573619:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff941603253000) 00010000:00010000:1.0:1790736288.573622:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736288.573634:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7005 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.573662:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7005 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.573694:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe700c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.573701:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe700c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.573708:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe700c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.573714:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60200 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736288.573717:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe700c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.573722:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe700c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.573730:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff941603253300) 00010000:00010000:1.0:1790736288.573732:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736288.573734:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe700c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.573740:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe700c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736288.573888:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ad18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+53:11563:x1877722797267456:12345-192.168.203.5@tcp:34:lfs.0 Request processed in 2164us (2647us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736288.573902:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 203 00000100:00100000:2.0:1790736288.645036:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736288.645405:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797267712 00000100:00100000:0.0:1790736288.645419:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797267712 00000100:00100000:0.0:1790736288.645485:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 204 00000100:00100000:0.0:1790736288.645493:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+53:11566:x1877722797267712:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1790736288.645516:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736288.645560:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff800/0x6aae200528fe7013 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a5270c0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.645642:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe701a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.645660:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe701a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.645672:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe701a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.645688:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe400/0x6aae200528fe7021 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.645694:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe400/0x6aae200528fe7021 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.645699:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe400/0x6aae200528fe7021 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.645838:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe7028 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.645847:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe7028 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.645854:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe7028 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790736288.645865:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1790736288.645957:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe701a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.646574:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe701a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.646586:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe701a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.646592:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9416013fe200 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736288.646597:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe701a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.646606:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe701a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.646619:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94161505de00) 00010000:00010000:0.0:1790736288.646623:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736288.646627:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe701a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.646634:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe200/0x6aae200528fe701a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.646650:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe400/0x6aae200528fe7021 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.646657:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe400/0x6aae200528fe7021 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.646662:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe400/0x6aae200528fe7021 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.646668:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9416013fe400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736288.646680:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe400/0x6aae200528fe7021 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.646687:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe400/0x6aae200528fe7021 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.646694:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff941605242800) 00010000:00010000:0.0:1790736288.646697:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736288.646700:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe400/0x6aae200528fe7021 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.646706:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9416013fe400/0x6aae200528fe7021 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.646760:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff800/0x6aae200528fe7013 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270c0 expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.646776:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe7028 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270c0 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.646783:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff941603253300) 00010000:00010000:0.0:1790736288.646786:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790736288.646788:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941642172200, rc 0) 00000100:00100000:0.0:1790736288.646949:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+55:11566:x1877722797267712:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1454us (1924us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1790736288.646963:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 204 00000100:00100000:2.0:1790736288.659766:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736288.659891:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797267840 00000100:00100000:0.0:1790736288.659902:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797267840 00000100:00100000:0.0:1790736288.659964:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 205 00000100:00100000:0.0:1790736288.659991:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162ed91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+55:11566:x1877722797267840:12345-192.168.203.5@tcp:54:lfs.0 00010000:00010000:0.0:1790736288.660070:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe7036 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.660089:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe7036 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.660338:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe7036 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.660367:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe7036 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.660375:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe7036 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.660392:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe7036 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.660398:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642173e00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736288.660401:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe7036 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.660408:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe7036 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.660418:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff941603253300) 00010000:00010000:0.0:1790736288.660421:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790736288.660425:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe7036 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.660432:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe7036 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736288.660515:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162ed91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+55:11566:x1877722797267840:12345-192.168.203.5@tcp:54:lfs.0 Request processed in 534us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736288.660521:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 205 00000100:00100000:3.0:1790736288.663202:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736288.663311:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797268096 00000100:00100000:2.0:1790736288.663320:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797268096 00000100:00100000:2.0:1790736288.663377:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 58 00000100:00100000:2.0:1790736288.663406:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ad19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+55:11566:x1877722797268096:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:2.0:1790736288.663698:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ad19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+56:11566:x1877722797268096:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 302us (505us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1790736288.663705:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 58 00000100:00100000:2.0:1790736288.732033:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736288.732141:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797268352 00000100:00100000:3.0:1790736288.732157:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797268352 00000100:00100000:3.0:1790736288.732246:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 206 00000100:00100000:3.0:1790736288.732259:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162ed93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+56:11576:x1877722797268352:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:3.0:1790736288.732301:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736288.732305:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790736288.732350:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff400/0x6aae200528fe6fb8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270a4 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736288.732376:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94161505de00) 00010000:00010000:3.0:1790736288.732389:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790736288.732413:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe703d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a5270c7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736288.732539:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe7044 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736288.732555:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe7028 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270c0 expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736288.732564:0:5844:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe7044 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736288.732605:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe7028 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0x92962417a5270c0 expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736288.732620:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe7028 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5270c0 expref: 56 pid: 5843 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736288.732649:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163ad19c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1877722816131840:192.168.203.5@tcp:104: 00000100:00100000:3.0:1790736288.732779:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416121786c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790736288.738582:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736288.738665:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163ad19c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1877722816131840:192.168.203.5@tcp:104: 00010000:00010000:3.0:1790736288.738702:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe7044 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736288.738904:0:8527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797268480 00000100:00100000:2.0:1790736288.738913:0:8527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797268480 00010000:00010000:2.0:1790736288.738965:0:8527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe7028 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5270c0 expref: 57 pid: 5843 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736288.739007:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 78 00000100:00100000:2.0:1790736288.739019:0:8527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162fafc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+57:2356:x1877722797268480:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790736288.739040:0:8527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790736288.739047:0:8527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe7028 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5270c0 expref: 57 pid: 5843 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.739079:0:8527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe7028 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5270c0 expref: 57 pid: 5843 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.739127:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe7028 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5270c0 expref: 57 pid: 5843 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.739149:0:8527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff941603253300) 00010000:00010000:2.0:1790736288.739155:0:8527:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe7044 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.739167:0:8527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe7044 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.739176:0:8527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe7044 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.739217:0:8527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790736288.739301:0:8527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162fafc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+56:2356:x1877722797268480:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 283us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736288.739310:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 78 00010000:00010000:1.0:1790736288.740129:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe7044 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.740142:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe7044 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790736288.740167:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1790736288.740614:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe703d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270c7 expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.740636:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe7044 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270c7 expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.740645:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff941603253300) 00010000:00010000:1.0:1790736288.740648:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790736288.740651:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c9400, rc 0) 00000100:00100000:1.0:1790736288.740760:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162ed93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+56:11576:x1877722797268352:12345-192.168.203.5@tcp:101:bash.0 Request processed in 8503us (8742us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1790736288.740769:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 206 00000100:00100000:0.0:1790736288.744918:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736288.745017:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797268736 00000100:00100000:1.0:1790736288.745032:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797268736 00000100:00100000:1.0:1790736288.745506:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 207 00000100:00100000:1.0:1790736288.745520:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162fafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+56:11576:x1877722797268736:12345-192.168.203.5@tcp:36:bash.0 00010000:00010000:1.0:1790736288.745875:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe7052 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.745899:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe7052 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.745914:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe7052 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790736288.745993:0:8114:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:1.0:1790736288.746019:0:8114:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003d5ca464 reply state 000000003ef6a162 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe7052 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736288.746029:0:8114:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790736288.746591:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162fafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+59:11576:x1877722797268736:12345-192.168.203.5@tcp:36:bash.0 Request processed in 1071us (1682us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1790736288.746599:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 207 00000020:00080000:1.0:1790736288.746606:0:8114:0:(tgt_main.c:787:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1790736288.750194:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736288.750248:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797268864 00000100:00100000:3.0:1790736288.750261:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797268864 00000100:00100000:3.0:1790736288.750624:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 208 00000100:00100000:3.0:1790736288.750637:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ad19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+59:11576:x1877722797268864:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:3.0:1790736288.750672:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736288.750703:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe7059 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a5270ce expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736288.750828:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe7060 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736288.750846:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe7044 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270c7 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736288.750855:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe7052 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736288.750862:0:5843:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe7060 lrc: 5/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736288.750910:0:5843:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe7052 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736288.750943:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe7044 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0x92962417a5270c7 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736288.750961:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe7044 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5270c7 expref: 60 pid: 5844 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736288.750979:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163ad1a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1877722816131968:192.168.203.5@tcp:104: 00000100:00100000:1.0:1790736288.751757:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416121786c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790736288.755327:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163ad1a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1877722816131968:192.168.203.5@tcp:104: 00010000:00010000:1.0:1790736288.755369:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe7060 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736288.755873:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736288.755972:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797268992 00000100:00100000:1.0:1790736288.755982:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797268992 00010000:00010000:1.0:1790736288.756037:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe7044 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5270c7 expref: 61 pid: 5844 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736288.756081:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 79 00000100:00100000:1.0:1790736288.756119:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ad1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+61:2356:x1877722797268992:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790736288.756141:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736288.756150:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe7044 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5270c7 expref: 61 pid: 5844 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.756164:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe7044 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5270c7 expref: 61 pid: 5844 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.756217:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe7044 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5270c7 expref: 61 pid: 5844 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.756249:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff941603253300) 00010000:00010000:1.0:1790736288.756255:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe7060 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.756264:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe7060 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.756271:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe7060 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.756450:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790736288.756541:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ad1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+60:2356:x1877722797268992:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 448us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736288.756550:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 79 00010000:00010000:0.0:1790736288.757971:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe7052 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.757993:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe7052 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.758020:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe7052 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.758364:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60200 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736288.758372:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe7052 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.758397:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe7052 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.758416:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff941603253300) 00010000:00010000:0.0:1790736288.758420:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736288.758423:0:3293:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe7060 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.758434:0:3293:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe7060 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.758444:0:3293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe7060 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.758569:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe7052 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.758578:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe7052 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.758937:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe7060 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.758947:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe7060 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790736288.759654:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1790736288.759661:0:5843:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790736288.759694:0:5843:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe7060 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.759745:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe7059 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270ce expref: 59 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.759857:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe7060 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270ce expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.759866:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff941603253300) 00010000:00010000:1.0:1790736288.759868:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790736288.759871:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c8e00, rc 0) 00000100:00100000:1.0:1790736288.759976:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ad19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+58:11576:x1877722797268864:12345-192.168.203.5@tcp:101:bash.0 Request processed in 9339us (9793us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736288.759990:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 208 00000100:00100000:3.0:1790736288.762759:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736288.764207:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797269248 00000100:00100000:2.0:1790736288.764222:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797269248 00000100:00100000:2.0:1790736288.764377:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 59 00000100:00100000:2.0:1790736288.764402:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+58:11576:x1877722797269248:12345-192.168.203.5@tcp:35:bash.0 00000100:00100000:2.0:1790736288.764730:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+59:11576:x1877722797269248:12345-192.168.203.5@tcp:35:bash.0 Request processed in 334us (1982us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1790736288.764738:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 59 00000100:00100000:2.0:1790736288.832217:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736288.832513:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797269376 00000100:00100000:0.0:1790736288.832527:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797269376 00000100:00100000:0.0:1790736288.832650:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 209 00000100:00100000:0.0:1790736288.832664:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162ed91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+59:11582:x1877722797269376:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1790736288.832697:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736288.832727:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe7067 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a5270d5 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.832822:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe706e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.832841:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe706e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.832856:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe706e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790736288.832904:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1790736288.832907:0:5845:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790736288.832932:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe706e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.832961:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe7067 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270d5 expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.833004:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe706e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270d5 expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.833014:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94161505de00) 00010000:00010000:0.0:1790736288.833018:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790736288.833023:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941642172200, rc 0) 00000100:00100000:0.0:1790736288.833168:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162ed91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+60:11582:x1877722797269376:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 506us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736288.833176:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 209 00000100:00100000:0.0:1790736288.837893:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736288.837995:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797269504 00000100:00100000:1.0:1790736288.838008:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797269504 00000100:00100000:1.0:1790736288.838083:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 210 00000100:00100000:1.0:1790736288.838164:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162fafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+60:11582:x1877722797269504:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1790736288.838196:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736288.838224:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7075 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a5270dc expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.838642:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe707c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.838662:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe707c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.838676:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe707c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.838695:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe7083 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.838712:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe7083 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.838719:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe7083 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.838847:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe708a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.838857:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe708a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.838864:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe708a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790736288.838914:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1790736288.838920:0:5844:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790736288.838942:0:5844:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe708a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.838956:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe708a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.839660:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe707c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.839672:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe707c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.839681:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe707c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.839705:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c61c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736288.839710:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe707c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.839719:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe707c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.839734:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94161505de00) 00010000:00010000:1.0:1790736288.839737:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736288.839743:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe707c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.839749:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe707c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.839766:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe7083 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.839772:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe7083 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.839778:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe7083 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.839783:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60200 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736288.839786:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe7083 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.839793:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe7083 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.839810:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff941603253000) 00010000:00010000:1.0:1790736288.839813:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736288.839816:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe7083 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.839821:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe7083 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.839873:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7075 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270dc expref: 62 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.839890:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe708a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270dc expref: 61 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.839897:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff941603253300) 00010000:00010000:1.0:1790736288.839899:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790736288.839902:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c60e00, rc 0) 00000100:00100000:1.0:1790736288.839998:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162fafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+61:11582:x1877722797269504:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1904us (2119us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736288.840008:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 210 00000100:00100000:3.0:1790736288.843157:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736288.843338:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797269632 00000100:00100000:2.0:1790736288.843359:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797269632 00000100:00100000:2.0:1790736288.843468:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 15 00000100:00100000:2.0:1790736288.843479:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+61:2354:x1877722797269632:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790736288.843500:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790736288.843529:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60e00/0x6aae200528fe708a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270dc expref: 61 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.843552:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff941603253300) 00010000:00010000:2.0:1790736288.843557:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790736288.843627:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+60:2354:x1877722797269632:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 149us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736288.843636:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 15 00000100:00100000:2.0:1790736288.847627:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736288.847805:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797269888 00000100:00100000:1.0:1790736288.847819:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797269888 00000100:00100000:1.0:1790736288.847892:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 211 00000100:00100000:1.0:1790736288.847904:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162ed93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+60:11582:x1877722797269888:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1790736288.847935:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736288.847963:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7091 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a5270e3 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.848162:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe7098 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.848180:0:8114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe7060 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270ce expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.848190:0:8114:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe7098 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.848349:0:8114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe7060 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0x92962417a5270ce expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.848367:0:8114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe7060 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5270ce expref: 61 pid: 5843 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736288.848487:0:8114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941642042d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8114:1877722816132096:192.168.203.5@tcp:104: 00000100:00100000:1.0:1790736288.848627:0:8114:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416119736c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790736288.852033:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736288.852593:0:8114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941642042d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8114:1877722816132096:192.168.203.5@tcp:104: 00010000:00010000:1.0:1790736288.852633:0:8114:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe7098 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736288.852725:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797270016 00000100:00100000:2.0:1790736288.852735:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797270016 00010000:00010000:2.0:1790736288.852785:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe7060 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5270ce expref: 62 pid: 5843 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736288.852832:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 80 00000100:00100000:2.0:1790736288.852842:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162fafdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+62:2356:x1877722797270016:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790736288.852864:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790736288.852873:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe7060 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5270ce expref: 62 pid: 5843 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.852884:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe7060 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5270ce expref: 62 pid: 5843 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.852932:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8e00/0x6aae200528fe7060 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5270ce expref: 62 pid: 5843 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.852952:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff941603253300) 00010000:00010000:2.0:1790736288.852958:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe7098 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.852970:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe7098 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.852979:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe7098 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.853008:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790736288.853157:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162fafdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+61:2356:x1877722797270016:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 314us (1138us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736288.853165:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 80 00010000:00010000:1.0:1790736288.854270:0:8114:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe7098 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.854285:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe7098 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790736288.854313:0:8114:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1790736288.854714:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7091 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270e3 expref: 62 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.854738:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe7098 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270e3 expref: 61 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.854748:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff941603253300) 00010000:00010000:1.0:1790736288.854751:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790736288.854754:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c60200, rc 0) 00000100:00100000:1.0:1790736288.854827:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162ed93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+61:11582:x1877722797269888:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 6925us (7213us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1790736288.854837:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 211 00000100:00100000:0.0:1790736288.859075:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736288.859359:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797270272 00000100:00100000:2.0:1790736288.859373:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797270272 00000100:00100000:2.0:1790736288.859469:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 16 00000100:00100000:2.0:1790736288.859481:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160557ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+61:11582:x1877722797270272:12345-192.168.203.5@tcp:103:lfs.0 00010000:00010000:2.0:1790736288.859503:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790736288.859536:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60600/0x6aae200528fe6ff7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270b9 expref: 61 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.859560:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff941603253300) 00010000:00010000:2.0:1790736288.859565:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790736288.859655:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160557ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+60:11582:x1877722797270272:12345-192.168.203.5@tcp:103:lfs.0 Request processed in 176us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736288.859664:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 16 00000100:00100000:3.0:1790736288.865971:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736288.866086:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797270400 00000100:00100000:0.0:1790736288.866149:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797270400 00000100:00100000:0.0:1790736288.866220:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 212 00000100:00100000:0.0:1790736288.866233:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+60:11582:x1877722797270400:12345-192.168.203.5@tcp:58:lfs.0 00010000:00010000:0.0:1790736288.866654:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe70a6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.866680:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe70a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.866694:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe70a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790736288.867007:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1790736288.867539:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+60:11582:x1877722797270400:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 1303us (1577us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736288.867569:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 212 00000100:00100000:0.0:1790736288.870348:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736288.870529:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797270528 00000100:00100000:2.0:1790736288.870542:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797270528 00000100:00100000:2.0:1790736288.870653:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 213 00000100:00100000:2.0:1790736288.870665:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162faff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+60:11582:x1877722797270528:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1790736288.870695:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736288.870726:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527200/0x6aae200528fe70ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a5270ea expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.870807:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe70a6 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.870820:0:5845:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527200/0x6aae200528fe70ad lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270ea expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.870844:0:5845:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe70a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.870860:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527200/0x6aae200528fe70ad lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270ea expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.870877:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff941603253300) 00010000:00010000:2.0:1790736288.870880:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790736288.870884:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527200/0x6aae200528fe70ad lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270ea expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.870892:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94163c527200, rc 0) 00000100:00100000:2.0:1790736288.870982:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162faff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+61:11582:x1877722797270528:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 318us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736288.870989:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 213 00000040:00080000:3.0:1790736288.918905:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790736288.918914:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790736288.919143:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1790736288.919151:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790736288.919358:0:11704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633e86a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11704:1877722816132352:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790736288.919596:0:11704:0:(client.c:2716:ptlrpc_set_wait()) set ffff941612178240 going to sleep for 11 seconds 00000100:00100000:1.0:1790736288.919682:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790736288.919698:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162ed90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816132224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790736288.919771:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736288.921357:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816132224 00000100:00100000:3.0:1790736288.921386:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816132224 00000100:00100000:3.0:1790736288.921554:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790736288.921568:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642042d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1877722816132224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790736288.921626:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790736288.921732:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642042d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1877722816132224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 168us (1960us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736288.921762:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1790736288.923341:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790736288.923452:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162ed90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816132224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790736288.927695:0:11704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633e86a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11704:1877722816132352:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790736288.933751:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736288.934728:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797270656 00000100:00100000:1.0:1790736288.934748:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797270656 00000100:00100000:1.0:1790736288.934833:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 214 00000100:00100000:1.0:1790736288.934846:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+61:11583:x1877722797270656:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790736288.934893:0:5844:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790736288.935063:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+61:11583:x1877722797270656:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 218us (1337us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736288.935073:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 214 00000100:00100000:0.0:1790736288.944315:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736288.945278:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797270784 00000100:00100000:1.0:1790736288.945294:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797270784 00000100:00100000:1.0:1790736288.945486:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 215 00000100:00100000:1.0:1790736288.945500:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162fafce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+61:11583:x1877722797270784:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1790736288.945617:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe70b4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.945642:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe70b4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.945657:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe70b4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.945934:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe70bb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.945980:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe70bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.945995:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe70bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.946030:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe70c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.946040:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe70c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.946046:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe70c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790736288.946148:0:8114:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1790736288.946153:0:8114:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790736288.946170:0:8114:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe70c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.946204:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe70b4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.946212:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe70b4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.946219:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe70b4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.946225:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c61800 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736288.946229:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe70b4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.946237:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe70b4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.946250:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94160678a900) 00010000:00010000:1.0:1790736288.946253:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736288.946257:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe70b4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.946263:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe70b4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.946278:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe70bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.946285:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe70bb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.946291:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe70bb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.946304:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c61c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736288.946307:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe70bb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.946313:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe70bb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.946324:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff941603253000) 00010000:00010000:1.0:1790736288.946327:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736288.946331:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe70bb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.946338:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe70bb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.946359:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe70c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.946366:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe70c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.946372:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe70c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.946388:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736288.946392:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe70c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.946398:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe70c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.946423:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff941603253300) 00010000:00010000:1.0:1790736288.946426:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736288.946430:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe70c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.946435:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe70c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736288.946546:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162fafce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+61:11583:x1877722797270784:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 Request processed in 1045us (2241us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736288.949193:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736288.949599:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 215 00000100:00100000:2.0:1790736288.961451:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797271040 00000100:00100000:2.0:1790736288.961476:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797271040 00000100:00100000:2.0:1790736288.961577:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 216 00000100:00100000:2.0:1790736288.961590:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c5e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+61:11583:x1877722797271040:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790736288.961618:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736288.961645:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527e00/0x6aae200528fe70c9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a5270f1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.961781:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe70d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.961800:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe70d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.961813:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe70d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790736288.961826:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1790736288.961946:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe70d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.961955:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe70d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.961963:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe70d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.961969:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163c526a00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736288.961992:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe70d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.962003:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe70d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.962019:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff941603253300) 00010000:00010000:2.0:1790736288.962022:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790736288.962028:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe70d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.962035:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe70d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.962088:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527e00/0x6aae200528fe70c9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270f1 expref: 63 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.962122:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94160678a900) 00010000:00010000:2.0:1790736288.962124:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790736288.962128:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527e00/0x6aae200528fe70c9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270f1 expref: 63 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.962138:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94163c527e00, rc 0) 00000100:00100000:2.0:1790736288.962467:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c5e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+62:11583:x1877722797271040:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 877us (13288us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1790736288.962475:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 216 00000100:00100000:3.0:1790736288.965639:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736288.965754:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797271168 00000100:00100000:1.0:1790736288.965768:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797271168 00000100:00100000:1.0:1790736288.965875:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 217 00000100:00100000:1.0:1790736288.965889:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162edc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+62:11583:x1877722797271168:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790736288.965948:0:8114:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790736288.966200:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162edc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+62:11583:x1877722797271168:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 312us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736288.966209:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 217 00000100:00100000:0.0:1790736288.975621:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736288.975718:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797271424 00000100:00100000:2.0:1790736288.975732:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797271424 00000100:00100000:2.0:1790736288.975808:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 218 00000100:00100000:2.0:1790736288.975820:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162fafe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+62:11583:x1877722797271424:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790736288.975871:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736288.975875:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790736288.975912:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642172200/0x6aae200528fe706e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270d5 expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.975942:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94161505de00) 00010000:00010000:2.0:1790736288.975949:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790736288.975966:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527e00/0x6aae200528fe70de lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a5270f8 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790736288.977082:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1790736288.977768:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe70e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.977847:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe70e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.977862:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe70e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.977938:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527e00/0x6aae200528fe70de lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270f8 expref: 64 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.977959:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe70e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270f8 expref: 63 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736288.977969:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94160678a200) 00010000:00010000:2.0:1790736288.977972:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790736288.977990:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94163c526a00, rc 0) 00000100:00100000:2.0:1790736288.978174:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162fafe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+63:11583:x1877722797271424:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 2355us (2568us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1790736288.978186:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 218 00000100:00100000:3.0:1790736288.981435:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736288.981516:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797271680 00000100:00100000:0.0:1790736288.981530:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797271680 00000100:00100000:0.0:1790736288.981620:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 219 00000100:00100000:0.0:1790736288.981633:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162edc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+63:11583:x1877722797271680:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790736288.981744:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790736288.981779:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe70e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270f8 expref: 63 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.981811:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94160678a200) 00010000:00010000:0.0:1790736288.981830:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790736288.981857:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe70f3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.981874:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe70f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.981883:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe70f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.981899:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe70fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xfa300aa5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.981907:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe70fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfa300aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.981925:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe70fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfa300aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.982014:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe70f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.982023:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe70f3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.982031:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe70f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.982038:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642173e00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736288.982042:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe70f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.982050:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe70f3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.982059:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94161505de00) 00010000:00010000:0.0:1790736288.982061:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736288.982066:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe70f3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.982072:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173e00/0x6aae200528fe70f3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.982082:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe70fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfa300aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.982088:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe70fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfa300aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.982980:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe70fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfa300aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.982985:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642173c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736288.982989:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe70fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfa300aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.982997:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe70fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfa300aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.983010:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xfa300aa5 (ffff941605242800) 00010000:00010000:0.0:1790736288.983012:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736288.983015:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe70fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xfa300aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736288.983021:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173c00/0x6aae200528fe70fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xfa300aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736288.984336:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162edc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+62:11583:x1877722797271680:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 2691us (2901us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790736288.984349:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 219 00000100:00100000:0.0:1790736288.991775:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736288.991870:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797271808 00000100:00100000:1.0:1790736288.991884:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797271808 00000100:00100000:1.0:1790736288.991963:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 220 00000100:00100000:1.0:1790736288.991976:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162fafc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+62:11583:x1877722797271808:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790736288.992008:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736288.992042:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe7101 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a5270ff expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.992149:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe7108 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.992180:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe7108 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.992198:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe7108 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.992396:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe7101 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270ff expref: 64 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.992581:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe7108 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270ff expref: 63 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736288.992593:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff941603253000) 00010000:00010000:1.0:1790736288.992597:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790736288.992601:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c61c00, rc 0) 00000100:00100000:1.0:1790736288.992683:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162fafc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+63:11583:x1877722797271808:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 710us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736288.992691:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 220 00000100:00100000:2.0:1790736289.001796:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736289.001986:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797272064 00000100:00100000:1.0:1790736289.001998:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797272064 00000100:00100000:1.0:1790736289.002118:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 221 00000100:00100000:1.0:1790736289.002130:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162ed90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+63:11583:x1877722797272064:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790736289.002271:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe710f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.002318:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe710f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.002331:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe710f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790736289.002686:0:8114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00010000:1.0:1790736289.002802:0:8114:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003e2e99b5 reply state 000000009f226cea transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe710f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736289.002813:0:8114:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00080000:2.0:1790736289.003504:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790736289.003689:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162ed90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+65:11583:x1877722797272064:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 1554us (1899us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1790736289.003700:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 221 00010000:00010000:1.0:1790736289.009283:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe710f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.009309:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe710f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.009317:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe710f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.009324:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c61800 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736289.009331:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe710f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.009340:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe710f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.009362:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff941603253000) 00010000:00010000:1.0:1790736289.009395:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790736289.009402:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe710f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.009410:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe710f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736289.010000:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736289.010846:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797272192 00000100:00100000:1.0:1790736289.010862:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797272192 00000100:00100000:1.0:1790736289.010935:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 222 00000100:00100000:1.0:1790736289.010948:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+64:11583:x1877722797272192:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790736289.010985:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736289.011011:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe7116 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a527106 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.011127:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe7116 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527106 expref: 65 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.011145:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe7116 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527106 expref: 65 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.011168:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff941603253000) 00010000:00010000:1.0:1790736289.011171:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790736289.011175:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c60400, rc 0) 00000100:00100000:1.0:1790736289.011261:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+65:11583:x1877722797272192:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 315us (1268us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736289.011270:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 222 00000100:00100000:2.0:1790736289.014737:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736289.014834:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797272320 00000100:00100000:1.0:1790736289.014849:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797272320 00000100:00100000:1.0:1790736289.014960:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 62 00000100:00100000:1.0:1790736289.014973:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ad1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+9:2355:x1877722797272320:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1790736289.016715:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ad1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+10:2355:x1877722797272320:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 Request processed in 1729us (1976us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1790736289.016732:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 62 00000100:00080000:2.0:1790736289.016991:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790736289.021057:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736289.023589:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797272576 00000100:00100000:1.0:1790736289.023612:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797272576 00000100:00100000:1.0:1790736289.023711:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 60 00000100:00100000:1.0:1790736289.023732:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162edc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+65:11583:x1877722797272576:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790736289.024079:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162edc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+66:11583:x1877722797272576:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 356us (3038us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1790736289.024088:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 60 00000100:00100000:2.0:1790736289.027777:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736289.031767:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797272832 00000100:00100000:0.0:1790736289.031787:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797272832 00000100:00100000:0.0:1790736289.031988:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 223 00000100:00100000:0.0:1790736289.031999:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ad1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+66:11583:x1877722797272832:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790736289.032804:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ad1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+66:11583:x1877722797272832:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 794us (5029us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736289.032837:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 223 00000100:00100000:0.0:1790736289.038335:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736289.038509:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797272960 00000100:00100000:1.0:1790736289.038522:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797272960 00000100:00100000:1.0:1790736289.038593:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 224 00000100:00100000:1.0:1790736289.038673:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162fafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+66:11583:x1877722797272960:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790736289.038704:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736289.038733:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe711d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a52710d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.038964:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe7124 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.038985:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe7124 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.038999:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe7124 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790736289.039067:0:5844:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790736289.039471:0:5844:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe7124 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.039508:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe711d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52710d expref: 68 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.039530:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe7124 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52710d expref: 67 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.039541:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff941603253000) 00010000:00010000:1.0:1790736289.039544:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1790736289.039550:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c60c00, rc 0) 00000100:00100000:1.0:1790736289.039999:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162fafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+67:11583:x1877722797272960:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 1328us (1678us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736289.040008:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 224 00000100:00100000:2.0:1790736289.054055:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736289.060904:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797273088 00000100:00100000:1.0:1790736289.060924:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797273088 00000100:00100000:1.0:1790736289.061080:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 63 00000100:00100000:1.0:1790736289.061120:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163393c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+10:2356:x1877722797273088:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790736289.061148:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736289.061182:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acef8c20/0x6aae200528fe712b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a527114 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790736289.061224:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abc77a1, blocks: 0x1 00010000:00010000:1.0:1790736289.061266:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=361s v=(0 0) 00010000:00010000:1.0:1790736289.061292:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790736289.061303:0:6697:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acef8c20/0x6aae200528fe712b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527114 expref: 11 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.061329:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000acef8c20/0x6aae200528fe712b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527114 expref: 11 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.061344:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c61800, rc 0) 00000100:00100000:1.0:1790736289.061449:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163393c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+11:2356:x1877722797273088:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 360us (7410us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736289.061457:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 63 00000100:00100000:2.0:1790736289.067869:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736289.068133:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797273344 00000100:00100000:3.0:1790736289.068148:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797273344 00000100:00100000:3.0:1790736289.068225:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 225 00000100:00100000:3.0:1790736289.068247:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163393d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+67:11583:x1877722797273344:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790736289.068404:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163393d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+67:11583:x1877722797273344:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 169us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736289.068412:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 225 00000100:00100000:3.0:1790736289.083160:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736289.083500:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797273472 00000100:00100000:1.0:1790736289.083514:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797273472 00000100:00100000:1.0:1790736289.083589:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 64 00000100:00100000:1.0:1790736289.084357:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+11:11583:x1877722797273472:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790736289.084407:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736289.084434:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000082e00f7/0x6aae200528fe7132 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a52711b expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.084480:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000acef8c20/0x6aae200528fe712b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527114 expref: 12 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.084489:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790736289.084494:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790736289.084499:0:6699:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000082e00f7/0x6aae200528fe7132 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52711b expref: 12 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.084568:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000acef8c20/0x6aae200528fe712b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0x92962417a527114 expref: 12 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.084585:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000acef8c20/0x6aae200528fe712b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527114 expref: 12 pid: 6697 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736289.084672:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163ae3b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6699:1877722816132480:192.168.203.5@tcp:104: 00000100:00100000:1.0:1790736289.084872:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611973e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790736289.094336:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163ae3b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6699:1877722816132480:192.168.203.5@tcp:104: 00010000:00010000:1.0:1790736289.094405:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000082e00f7/0x6aae200528fe7132 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0x92962417a52711b expref: 12 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.094434:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c61400, rc 0) 00000100:00100000:1.0:1790736289.094513:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+12:11583:x1877722797273472:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 10914us (11367us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736289.094524:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 64 00000100:00100000:2.0:1790736289.096550:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736289.096911:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797273600 00000100:00100000:1.0:1790736289.096927:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797273600 00010000:00010000:1.0:1790736289.096994:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000acef8c20/0x6aae200528fe712b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527114 expref: 12 pid: 6697 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736289.097045:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 81 00000100:00100000:1.0:1790736289.097058:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163393df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+12:2355:x1877722797273600:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790736289.097127:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736289.097161:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000acef8c20/0x6aae200528fe712b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527114 expref: 12 pid: 6697 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.097178:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000acef8c20/0x6aae200528fe712b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527114 expref: 12 pid: 6697 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.097211:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acef8c20/0x6aae200528fe712b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527114 expref: 12 pid: 6697 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.097244:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790736289.097250:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790736289.097260:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000082e00f7/0x6aae200528fe7132 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0x92962417a52711b expref: 11 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.097272:0:5829:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000082e00f7/0x6aae200528fe7132 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0x92962417a52711b expref: 11 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.097415:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000082e00f7/0x6aae200528fe7132 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0x92962417a52711b expref: 11 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736289.097432:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163ae39500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5829:1877722816132608:192.168.203.5@tcp:105: 00000100:00100000:1.0:1790736289.097544:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611973e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790736289.114532:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163ae39500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5829:1877722816132608:192.168.203.5@tcp:105: 00010000:00010000:1.0:1790736289.114575:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790736289.114682:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163393df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+11:2355:x1877722797273600:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 17624us (18143us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736289.114696:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 81 00000100:00100000:2.0:1790736289.115918:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736289.116450:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797273728 00000100:00100000:1.0:1790736289.116468:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797273728 00002000:00100000:1.0:1790736289.116563:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff94163393ed80 x1877722797273728/t0(0) o4->f945944d-9086-46a2-a91c-8bc7b88e8918@192.168.203.5@tcp:120/0 lens 504/0 e 0 to 0 dl 1790736300 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790736289.116578:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94163393ed80 with x1877722797273728 ext(0->12) 00002000:00010000:1.0:1790736289.116587:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94163393ed80 00000100:00100000:1.0:1790736289.117548:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6 00000100:00100000:1.0:1790736289.117570:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163393ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+11:2355:x1877722797273728:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1790736289.118258:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163393ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+13:2355:x1877722797273728:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 692us (2347us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1790736289.118268:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6 00002000:00100000:1.0:1790736289.118278:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff94163393ed80 x1877722797273728/t4294967320(0) o4->f945944d-9086-46a2-a91c-8bc7b88e8918@192.168.203.5@tcp:120/0 lens 504/448 e 0 to 0 dl 1790736300 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790736289.118289:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94163393ed80 with x1877722797273728 ext(0->12) 00002000:00010000:1.0:1790736289.118295:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94163393ed80 00000100:00100000:2.0:1790736289.124813:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736289.124973:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797273856 00000100:00100000:0.0:1790736289.125194:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797273856 00000100:00100000:0.0:1790736289.125403:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 226 00000100:00100000:0.0:1790736289.125416:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163393f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+67:11583:x1877722797273856:12345-192.168.203.5@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1790736289.264028:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967496 is committed 00000001:00080000:0.0:1790736289.264071:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:0.0:1790736289.264125:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:0.0:1790736289.264169:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff941605768e40 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1790736289.264175:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff941633820600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff941605768b40 00000020:00080000:0.0:1790736289.264179:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff941633820100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94162f522400 00000020:00080000:0.0:1790736289.264209:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 6 committed batchid 5 00000020:00080000:0.0:1790736289.264508:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000004:00080000:0.0:1790736289.264541:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:0.0:1790736289.264560:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9416112c1d80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1790736289.264564:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94163b7bc000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9416112c1000 00000020:00080000:0.0:1790736289.264567:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94163b7bc500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff941637d36000 00000100:00100000:0.0:1790736289.264736:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162fafdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816132736:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1790736289.264828:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736289.264938:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816132736 00000100:00100000:0.0:1790736289.264947:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816132736 00000100:00100000:0.0:1790736289.265004:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790736289.265014:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162fafe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1877722816132736:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1790736289.265075:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:0.0:1790736289.265150:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6abc77a0, atime: 0x6abc77a0, ctime: 0x6abc77a0, blocks: 0x1 00000100:00100000:2.0:1790736289.265325:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163393c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816132864:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1790736289.265360:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736289.265409:0:8632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816132864 00000100:00100000:2.0:1790736289.265414:0:8632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816132864 00000100:00100000:2.0:1790736289.265443:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790736289.265449:0:8632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94150133ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1877722816132864:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1790736289.265462:0:8632:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:2.0:1790736289.265483:0:8632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000712807a8/0x6aae200528fe7140 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.265510:0:8632:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000083374fc2/0x6aae200528fe6efb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.5@tcp remote: 0x92962417a52707a expref: 12 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.265532:0:8632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1790736289.265537:0:8632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790736289.265543:0:8632:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000712807a8/0x6aae200528fe7140 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.265577:0:8632:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000083374fc2/0x6aae200528fe6efb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.5@tcp remote: 0x92962417a52707a expref: 12 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.265594:0:8632:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000083374fc2/0x6aae200528fe6efb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.5@tcp remote: 0x92962417a52707a expref: 12 pid: 8632 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736289.265608:0:8632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94150133c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8632:1877722816132992:192.168.203.5@tcp:104: 00000100:00100000:2.0:1790736289.265691:0:8632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416131649c0 going to sleep for 11 seconds 00000020:00080000:3.0:1790736289.268535:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1790736289.268644:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1790736289.269180:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163393f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+24:11583:x1877722797273856:12345-192.168.203.5@tcp:44:lhsmtool_posix.0 Request processed in 143759us (144379us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736289.269193:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 226 00000100:00100000:2.0:1790736289.270017:0:8632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94150133c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8632:1877722816132992:192.168.203.5@tcp:104: 00010000:00010000:2.0:1790736289.270051:0:8632:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000712807a8/0x6aae200528fe7140 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736289.270141:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006eaa3fa5/0x6aae200528fe7139 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736289.270158:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=361s v=(0 0) 00010000:00010000:0.0:1790736289.270163:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736289.270170:0:6698:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006eaa3fa5/0x6aae200528fe7139 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736289.270191:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006eaa3fa5/0x6aae200528fe7139 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736289.270204:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006eaa3fa5/0x6aae200528fe7139 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736289.270213:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006eaa3fa5/0x6aae200528fe7139 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736289.270978:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736289.271124:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797273984 00000100:00100000:3.0:1790736289.271135:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797273984 00010000:00010000:3.0:1790736289.271185:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000083374fc2/0x6aae200528fe6efb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.5@tcp remote: 0x92962417a52707a expref: 13 pid: 8632 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736289.271240:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 82 00000100:00100000:3.0:1790736289.271271:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94150133c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+13:2356:x1877722797273984:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790736289.271291:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790736289.271298:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000083374fc2/0x6aae200528fe6efb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.5@tcp remote: 0x92962417a52707a expref: 13 pid: 8632 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736289.271313:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000083374fc2/0x6aae200528fe6efb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.5@tcp remote: 0x92962417a52707a expref: 13 pid: 8632 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736289.271348:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083374fc2/0x6aae200528fe6efb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.5@tcp remote: 0x92962417a52707a expref: 13 pid: 8632 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736289.271370:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790736289.271382:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790736289.271389:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000712807a8/0x6aae200528fe7140 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736289.271399:0:5828:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000712807a8/0x6aae200528fe7140 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736289.271433:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790736289.272631:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790736289.273483:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94150133c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+12:2356:x1877722797273984:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 2204us (2503us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736289.273498:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 82 00000100:00100000:0.0:1790736289.274526:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162fafe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1877722816132736:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9505us (9690us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1790736289.274540:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:3.0:1790736289.274666:0:8632:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000712807a8/0x6aae200528fe7140 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736289.274706:0:8632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000712807a8/0x6aae200528fe7140 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736289.274721:0:8632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000712807a8/0x6aae200528fe7140 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736289.274732:0:8632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000712807a8/0x6aae200528fe7140 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790736289.275037:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94162fafdf80/2, rc 0, transno 4294967310 00000100:00100000:2.0:1790736289.275048:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162fafdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816132736:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1790736289.278817:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790736289.278838:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006eaa3fa5/0x6aae200528fe7139 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.278857:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642173c00 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:1.0:1790736289.278863:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006eaa3fa5/0x6aae200528fe7139 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.278915:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006eaa3fa5/0x6aae200528fe7139 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.278948:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006eaa3fa5/0x6aae200528fe7139 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.278957:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006eaa3fa5/0x6aae200528fe7139 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.279002:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790736289.279007:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000712807a8/0x6aae200528fe7140 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.279014:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163c527800 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:1.0:1790736289.279018:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000712807a8/0x6aae200528fe7140 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.279025:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000712807a8/0x6aae200528fe7140 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.279035:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000712807a8/0x6aae200528fe7140 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.279044:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736289.279046:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736289.279053:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736289.284574:0:8632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790736289.284597:0:8632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000712807a8/0x6aae200528fe7140 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736289.285364:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736289.286622:0:8632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94150133ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3309:x1877722816132864:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21162us (21250us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1790736289.286639:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790736289.286746:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736289.286847:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797274112 00000100:00100000:2.0:1790736289.286859:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797274112 00000100:00100000:2.0:1790736289.286924:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 67 00000100:00100000:2.0:1790736289.286935:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162edc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+12:2356:x1877722797274112:12345-192.168.203.5@tcp:16:lhsmtool_posix.0 00000004:00080000:0.0:1790736289.288279:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94163393c380/2, rc 0, transno 4294967321 00000100:00100000:0.0:1790736289.288303:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163393c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816132864:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1790736289.352220:0:6725:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:0.0:1790736289.352456:0:6725:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:0.0:1790736289.352499:0:6725:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:0.0:1790736289.352505:0:6725:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:3.0:1790736289.352575:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162edc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+7:2356:x1877722797274112:12345-192.168.203.5@tcp:16:lhsmtool_posix.0 Request processed in 65633us (65823us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736289.352590:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 67 00000100:00100000:3.0:1790736289.362701:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736289.362752:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797274368 00000100:00100000:1.0:1790736289.362765:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797274368 00000100:00100000:1.0:1790736289.362849:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 227 00000100:00100000:1.0:1790736289.362861:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+21:11583:x1877722797274368:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790736289.362934:0:8114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736289.362983:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe7124 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52710d expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.363010:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff941603253000) 00010000:00010000:1.0:1790736289.363016:0:8114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790736289.363068:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7147 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.363087:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7147 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.363233:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7147 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790736289.363932:0:8114:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000efb291bf reply state 0000000000bcb243 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7147 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736289.363947:0:8114:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790736289.364213:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+22:11583:x1877722797274368:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 1350us (1523us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1790736289.364222:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 227 00000100:00100000:2.0:1790736289.374468:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736289.374659:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797274496 00000100:00100000:1.0:1790736289.374673:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797274496 00000100:00100000:1.0:1790736289.374747:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 68 00000100:00100000:1.0:1790736289.374759:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94150133ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+7:2355:x1877722797274496:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1790736289.375755:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1790736289.375763:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1790736289 00002000:00010000:1.0:1790736289.375766:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1790736288 00002000:00010000:1.0:1790736289.375768:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1790736289 -> 1790736289 00002000:00010000:1.0:1790736289.375770:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1790736289.375960:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7147 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736289.375974:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7147 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736289.375982:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7147 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736289.375988:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c61800 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736289.375994:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7147 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736289.376003:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7147 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736289.376022:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff941603253000) 00010000:00010000:0.0:1790736289.376025:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736289.376031:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7147 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736289.376037:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7147 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736289.376149:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94150133ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+8:2355:x1877722797274496:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 Request processed in 1387us (1694us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1790736289.376161:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 68 00000100:00100000:0.0:1790736289.381975:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736289.382140:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797274752 00000100:00100000:1.0:1790736289.382154:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797274752 00000100:00100000:1.0:1790736289.382231:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 228 00000100:00100000:1.0:1790736289.382242:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162fafc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+21:11583:x1877722797274752:12345-192.168.203.5@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1790736289.382341:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe714e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.382364:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe7108 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270ff expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.382383:0:5844:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe714e lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.382429:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe7108 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0x92962417a5270ff expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.382446:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe7108 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5270ff expref: 21 pid: 5844 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736289.382462:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163ae39500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1877722816133120:192.168.203.5@tcp:104: 00000100:00100000:1.0:1790736289.382700:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611973cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790736289.391912:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163ae39500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1877722816133120:192.168.203.5@tcp:104: 00010000:00010000:1.0:1790736289.392544:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe714e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736289.393201:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736289.393384:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797274880 00000100:00100000:3.0:1790736289.393396:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797274880 00010000:00010000:3.0:1790736289.393447:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe7108 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5270ff expref: 22 pid: 5844 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736289.393482:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 83 00000100:00100000:3.0:1790736289.393493:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162fafc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+22:2356:x1877722797274880:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790736289.393511:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790736289.393518:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe7108 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5270ff expref: 22 pid: 5844 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736289.393543:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe7108 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5270ff expref: 22 pid: 5844 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736289.393570:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61c00/0x6aae200528fe7108 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5270ff expref: 22 pid: 5844 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736289.393590:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff941603253000) 00010000:00010000:3.0:1790736289.393595:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe714e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736289.393607:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe714e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736289.393616:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe714e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736289.393664:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790736289.393732:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162fafc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+21:2356:x1877722797274880:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 239us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736289.393742:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 83 00010000:00010000:2.0:1790736289.395012:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe714e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.395031:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe714e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.395075:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe714e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.395085:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe714e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.395131:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe714e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.395140:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736289.395145:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe714e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.395155:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe714e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.395173:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff941603253000) 00010000:00010000:2.0:1790736289.395176:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1790736289.395180:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe714e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.395186:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60c00/0x6aae200528fe714e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736289.395319:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162fafc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+20:11583:x1877722797274752:12345-192.168.203.5@tcp:55:lhsmtool_posix.0 Request processed in 13074us (13354us total) trans 0 rc -22/-22 00000100:00100000:2.0:1790736289.395331:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 228 00000100:00100000:0.0:1790736289.407088:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736289.407296:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797275008 00000100:00100000:3.0:1790736289.407310:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797275008 00000100:00100000:3.0:1790736289.407389:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 69 00000100:00100000:3.0:1790736289.407402:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162faff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+8:2356:x1877722797275008:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1790736289.407464:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cf5bfa08/0x6aae200528fe7155 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736289.407501:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000082e00f7/0x6aae200528fe7132 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0x92962417a52711b expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736289.407512:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790736289.407517:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790736289.407522:0:6697:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf5bfa08/0x6aae200528fe7155 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736289.407579:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000082e00f7/0x6aae200528fe7132 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.5@tcp remote: 0x92962417a52711b expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736289.407607:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000082e00f7/0x6aae200528fe7132 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a52711b expref: 8 pid: 6699 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736289.407625:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6697:1877722816133248:192.168.203.5@tcp:104: 00000100:00100000:3.0:1790736289.407774:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416121780c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790736289.416246:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736289.416850:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797275136 00000100:00100000:3.0:1790736289.416865:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797275136 00010000:00010000:3.0:1790736289.416922:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000082e00f7/0x6aae200528fe7132 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a52711b expref: 9 pid: 6699 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736289.416954:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6697:1877722816133248:192.168.203.5@tcp:104: 00010000:00010000:1.0:1790736289.416993:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cf5bfa08/0x6aae200528fe7155 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736289.416997:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 84 00000100:00100000:3.0:1790736289.417008:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162fafca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+9:2356:x1877722797275136:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790736289.417030:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790736289.417265:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000082e00f7/0x6aae200528fe7132 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a52711b expref: 9 pid: 6699 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736289.417281:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000082e00f7/0x6aae200528fe7132 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a52711b expref: 9 pid: 6699 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736289.417310:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000082e00f7/0x6aae200528fe7132 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.5@tcp remote: 0x92962417a52711b expref: 9 pid: 6699 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736289.417330:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790736289.417335:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790736289.417350:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cf5bfa08/0x6aae200528fe7155 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736289.417364:0:5828:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf5bfa08/0x6aae200528fe7155 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736289.417671:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790736289.417768:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162fafca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+8:2356:x1877722797275136:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 759us (1531us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736289.417778:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 84 00010000:00010000:1.0:1790736289.417992:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cf5bfa08/0x6aae200528fe7155 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.418002:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf5bfa08/0x6aae200528fe7155 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.418032:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cf5bfa08/0x6aae200528fe7155 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.418042:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf5bfa08/0x6aae200528fe7155 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.418051:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf5bfa08/0x6aae200528fe7155 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.418058:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c8e00 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:1.0:1790736289.418062:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf5bfa08/0x6aae200528fe7155 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.418072:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf5bfa08/0x6aae200528fe7155 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.418126:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf5bfa08/0x6aae200528fe7155 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.418135:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf5bfa08/0x6aae200528fe7155 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736289.418207:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162faff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+7:2356:x1877722797275008:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 10808us (11136us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736289.418217:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 69 00000100:00100000:0.0:1790736289.426282:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736289.427335:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797275392 00000100:00100000:2.0:1790736289.427351:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797275392 00000100:00100000:2.0:1790736289.427505:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 229 00000100:00100000:2.0:1790736289.427516:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162fafd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+20:11583:x1877722797275392:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790736289.427646:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527e00/0x6aae200528fe715c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.427669:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527e00/0x6aae200528fe715c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.427683:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527e00/0x6aae200528fe715c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.427966:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526c00/0x6aae200528fe7163 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.427980:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe7116 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527106 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.427991:0:5843:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526c00/0x6aae200528fe7163 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.428038:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe7116 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0x92962417a527106 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.428056:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe7116 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527106 expref: 21 pid: 5844 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736289.428126:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94150133f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1877722816133376:192.168.203.5@tcp:104: 00000100:00100000:2.0:1790736289.428251:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611ff40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790736289.435959:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94150133f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1877722816133376:192.168.203.5@tcp:104: 00010000:00010000:2.0:1790736289.435999:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526c00/0x6aae200528fe7163 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736289.441357:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736289.444369:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797275520 00000100:00100000:3.0:1790736289.444402:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797275520 00010000:00010000:3.0:1790736289.444467:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe7116 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527106 expref: 22 pid: 5844 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736289.445891:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 85 00000100:00100000:2.0:1790736289.445914:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162faffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+22:2355:x1877722797275520:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790736289.445937:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790736289.445948:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe7116 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527106 expref: 22 pid: 5844 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.445963:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe7116 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527106 expref: 22 pid: 5844 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.445991:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe7116 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527106 expref: 22 pid: 5844 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.446012:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff941603253000) 00010000:00010000:2.0:1790736289.446020:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526c00/0x6aae200528fe7163 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.446031:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526c00/0x6aae200528fe7163 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.446040:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526c00/0x6aae200528fe7163 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.447886:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790736289.448008:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162faffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+21:2355:x1877722797275520:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 2098us (6657us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736289.448022:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 85 00010000:00010000:0.0:1790736289.448193:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526c00/0x6aae200528fe7163 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736289.448206:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526c00/0x6aae200528fe7163 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790736289.448455:0:5843:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1790736289.448664:0:5843:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1790736289.448714:0:5843:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1790736289.448823:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162faff800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1877722816133504:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790736289.448900:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736289.448943:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff941637e9ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1790736289.450982:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816133504 00000100:00100000:1.0:1790736289.451002:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816133504 00000100:00100000:1.0:1790736289.451088:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790736289.451125:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163381b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1877722816133504:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1790736289.451797:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163381b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1877722816133504:12345-0@lo:1000:mdt00_000.0 Request processed in 673us (2893us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736289.451807:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790736289.452852:0:5843:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:2.0:1790736289.452864:0:5843:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:2.0:1790736289.452893:0:5843:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94163393c380, transno 4294967321 00000100:00100000:2.0:1790736289.452929:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162faff800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1877722816133504:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1790736289.454168:0:5843:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1790736289.454402:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94150133f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1877722816133632:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790736289.454511:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736289.455126:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816133632 00000100:00100000:3.0:1790736289.455137:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816133632 00000100:00100000:3.0:1790736289.455198:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790736289.455209:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94150133d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1877722816133632:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1790736289.455462:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94150133d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5843:x1877722816133632:12345-0@lo:1000:mdt00_000.0 Request processed in 254us (951us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1790736289.455470:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790736289.455764:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff941605768480 going to sleep for 11 seconds 00000100:00100000:2.0:1790736289.455802:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94150133f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1877722816133632:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1790736289.455850:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526c00/0x6aae200528fe7163 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.455862:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526c00/0x6aae200528fe7163 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.455871:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526c00/0x6aae200528fe7163 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.455877:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163c526c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736289.455883:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526c00/0x6aae200528fe7163 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.455892:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526c00/0x6aae200528fe7163 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.455924:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff941603253000) 00010000:00010000:2.0:1790736289.455927:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790736289.455932:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526c00/0x6aae200528fe7163 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.455939:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526c00/0x6aae200528fe7163 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.455976:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe70a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.455981:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe70a6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.455986:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe70a6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.455991:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642173200 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736289.455994:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe70a6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.456001:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe70a6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.456008:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff941603253300) 00010000:00010000:2.0:1790736289.456010:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790736289.456018:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527200/0x6aae200528fe70ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270ea expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.456031:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527200/0x6aae200528fe70ad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270ea expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.456047:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527200/0x6aae200528fe70ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270ea expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.456082:0:5843:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527200/0x6aae200528fe70ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270ea expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736289.456112:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94150133f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1877722816133760:192.168.203.5@tcp:105: 00000100:00100000:2.0:1790736289.456190:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff941605768480 going to sleep for 11 seconds 00000100:00100000:2.0:1790736289.460491:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94150133f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1877722816133760:192.168.203.5@tcp:105: 00010000:00010000:2.0:1790736289.460534:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe70a6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.460546:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe70a6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.460799:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe716a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.460818:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe716a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.460831:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe716a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.460842:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe716a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.460849:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe716a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.460875:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe716a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.460882:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163c526a00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736289.460886:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe716a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.460895:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe716a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.460910:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff941603253300) 00010000:00010000:2.0:1790736289.460913:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790736289.460917:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe716a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.460923:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe716a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.460935:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527e00/0x6aae200528fe715c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.460941:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527e00/0x6aae200528fe715c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.460946:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527e00/0x6aae200528fe715c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.460951:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163c527e00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736289.460954:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527e00/0x6aae200528fe715c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.460972:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527e00/0x6aae200528fe715c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.460980:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff941603253300) 00010000:00010000:2.0:1790736289.460982:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790736289.460984:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527e00/0x6aae200528fe715c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.460989:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527e00/0x6aae200528fe715c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736289.461928:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162fafd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+24:11583:x1877722797275392:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 34404us (35649us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1790736289.461943:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 229 00000020:00080000:2.0:1790736289.461949:0:5843:0:(tgt_main.c:787:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1790736289.463079:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736289.463200:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797275648 00000100:00100000:1.0:1790736289.463214:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797275648 00000100:00100000:1.0:1790736289.463289:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 61 00000100:00100000:1.0:1790736289.463300:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+24:11582:x1877722797275648:12345-192.168.203.5@tcp:49:lfs.0 00000100:00100000:1.0:1790736289.463836:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+24:11582:x1877722797275648:12345-192.168.203.5@tcp:49:lfs.0 Request processed in 534us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736289.463846:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 61 00000040:00080000:2.0:1790736289.464460:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790736289.464468:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790736289.466252:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1790736289.466276:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790736289.469362:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736289.469929:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797275904 00000100:00100000:3.0:1790736289.469944:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797275904 00000100:00100000:2.0:1790736289.470163:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 62 00000100:00100000:2.0:1790736289.470175:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416114ef050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+24:11583:x1877722797275904:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1790736289.471161:0:5846:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1790736289.471316:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1790736289.471388:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527600/0x6aae200528fe7171 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.471415:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527600/0x6aae200528fe7171 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.471443:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527600/0x6aae200528fe7171 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.471455:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527600/0x6aae200528fe7171 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.471462:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527600/0x6aae200528fe7171 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.471470:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527600/0x6aae200528fe7171 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.471494:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790736289.471635:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416114ef050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+26:11583:x1877722797275904:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 1458us (2283us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1790736289.471647:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 62 00000020:00080000:2.0:1790736289.471654:0:5846:0:(tgt_main.c:787:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790736289.472079:0:11186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790736289.472090:0:11186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527600/0x6aae200528fe7171 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736289.472121:0:11186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163c527600 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:3.0:1790736289.472126:0:11186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527600/0x6aae200528fe7171 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736289.472135:0:11186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527600/0x6aae200528fe7171 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736289.472152:0:11186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94160678a300) 00010000:00010000:3.0:1790736289.472155:0:11186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790736289.472169:0:11186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527600/0x6aae200528fe7171 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736289.472176:0:11186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527600/0x6aae200528fe7171 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736289.472201:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736289.472203:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736289.472205:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736289.475051:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736289.475168:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797276160 00000100:00100000:3.0:1790736289.475183:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797276160 00000100:00100000:3.0:1790736289.475247:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 230 00000100:00100000:3.0:1790736289.475259:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+26:11582:x1877722797276160:12345-192.168.203.5@tcp:58:lfs.0 00000040:00080000:0.0:1790736289.476139:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1790736289.476288:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+26:11582:x1877722797276160:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 1026us (1246us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736289.476298:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 230 00000100:00100000:2.0:1790736289.505656:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736289.505730:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797276288 00000100:00100000:3.0:1790736289.505746:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797276288 00000100:00100000:3.0:1790736289.505940:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 231 00000100:00100000:3.0:1790736289.505954:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94150133f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+26:11585:x1877722797276288:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1790736289.505988:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736289.506276:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe7178 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a527122 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.506434:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527e00/0x6aae200528fe717f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.506456:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527e00/0x6aae200528fe717f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.506471:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527e00/0x6aae200528fe717f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.506602:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe7186 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.506611:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe7186 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.506618:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe7186 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.507149:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526c00/0x6aae200528fe718d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.507165:0:8114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe7098 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270e3 expref: 27 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.507174:0:8114:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526c00/0x6aae200528fe718d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.507217:0:8114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe7098 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0x92962417a5270e3 expref: 27 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.508074:0:8114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe7098 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5270e3 expref: 27 pid: 8114 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736289.508156:0:8114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94150133d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8114:1877722816133888:192.168.203.5@tcp:104: 00000100:00100000:2.0:1790736289.508555:0:8114:0:(client.c:2716:ptlrpc_set_wait()) set ffff941605768600 going to sleep for 11 seconds 00000100:00100000:1.0:1790736289.515073:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736289.515368:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797276544 00000100:00100000:3.0:1790736289.515403:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797276544 00000100:00100000:3.0:1790736289.515486:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 63 00000100:00100000:3.0:1790736289.515498:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+28:5592:x1877722797276544:12345-192.168.203.5@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1790736289.516122:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+29:5592:x1877722797276544:12345-192.168.203.5@tcp:35:ldlm_bl.0 Request processed in 596us (1034us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1790736289.516133:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 63 00000100:00100000:2.0:1790736289.516153:0:8114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94150133d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8114:1877722816133888:192.168.203.5@tcp:104: 00010000:00010000:2.0:1790736289.516187:0:8114:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526c00/0x6aae200528fe718d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736289.525461:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736289.525773:0:8527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797276672 00000100:00100000:2.0:1790736289.525795:0:8527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797276672 00010000:00010000:2.0:1790736289.525860:0:8527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe7098 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5270e3 expref: 29 pid: 8114 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736289.525917:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 86 00000100:00100000:2.0:1790736289.525929:0:8527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+29:2356:x1877722797276672:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790736289.525954:0:8527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790736289.525962:0:8527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe7098 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5270e3 expref: 29 pid: 8114 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.525977:0:8527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe7098 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5270e3 expref: 29 pid: 8114 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.526019:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60200/0x6aae200528fe7098 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5270e3 expref: 29 pid: 8114 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.526040:0:8527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff941603253300) 00010000:00010000:2.0:1790736289.526046:0:8527:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526c00/0x6aae200528fe718d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.526059:0:8527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526c00/0x6aae200528fe718d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.526069:0:8527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526c00/0x6aae200528fe718d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736289.526147:0:8527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790736289.526237:0:8527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+28:2356:x1877722797276672:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 309us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736289.526246:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 86 00010000:00010000:0.0:1790736289.528260:0:8114:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526c00/0x6aae200528fe718d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736289.528280:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526c00/0x6aae200528fe718d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790736289.528430:0:8114:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1790736289.528436:0:8114:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790736289.528465:0:8114:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526c00/0x6aae200528fe718d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.528483:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526c00/0x6aae200528fe718d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.528496:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527e00/0x6aae200528fe717f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.528505:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527e00/0x6aae200528fe717f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.528514:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527e00/0x6aae200528fe717f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.528520:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163c527e00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736289.528525:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527e00/0x6aae200528fe717f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.528534:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527e00/0x6aae200528fe717f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.528550:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94161505de00) 00010000:00010000:1.0:1790736289.528554:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736289.528560:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527e00/0x6aae200528fe717f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.528567:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527e00/0x6aae200528fe717f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.528607:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe7186 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.528615:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe7186 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.528621:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe7186 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.528626:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163c526a00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736289.528628:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe7186 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.528634:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe7186 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.528641:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94160678a000) 00010000:00010000:1.0:1790736289.528644:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736289.528646:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe7186 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.528651:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526a00/0x6aae200528fe7186 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.528700:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8a00/0x6aae200528fe7178 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527122 expref: 28 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.528716:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526c00/0x6aae200528fe718d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527122 expref: 27 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736289.528735:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff941603253300) 00010000:00010000:1.0:1790736289.528738:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790736289.528741:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94163c526c00, rc 0) 00000100:00100000:1.0:1790736289.528888:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94150133f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+27:11585:x1877722797276288:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 22935us (23247us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736289.528898:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 231 00010000:00010000:1.0:1790736289.557638:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736289.791352:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736289.791423:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736289.791473:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736289.791836:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797277056 00000100:00100000:3.0:1790736289.791851:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797277056 00000100:00100000:3.0:1790736289.791942:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 154 00000100:00100000:3.0:1790736289.791954:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2355:x1877722797277056:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736289.792077:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2355:x1877722797277056:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 126us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736289.792086:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 154 00000100:00100000:3.0:1790736289.792153:0:8632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797276928 00000100:00100000:3.0:1790736289.792157:0:8632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797276928 00000100:00100000:3.0:1790736289.792186:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 91 00000100:00100000:3.0:1790736289.792193:0:8632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+7:2355:x1877722797276928:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736289.792221:0:8632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+7:2355:x1877722797276928:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 29us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736289.792329:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797276800 00000100:00100000:0.0:1790736289.792334:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797276800 00000100:00100000:0.0:1790736289.792366:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 296 00000100:00100000:0.0:1790736289.792382:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606656450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+13:2355:x1877722797276800:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1790736289.792415:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606656450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+13:2355:x1877722797276800:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 43us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736289.792421:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 296 00000100:00080000:1.0:1790736289.793318:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790736289.793477:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 91 00000100:00100000:1.0:1790736289.941681:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816134016:0@lo:400:kworker.0 00000100:00100000:0.0:1790736289.941681:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877722816134144:0@lo:400:kworker.0 00000100:00100000:2.0:1790736289.941748:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1877722816134272:0@lo:400:kworker.0 00000100:00100000:1.0:1790736289.943329:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736289.943536:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163380f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1877722816134400:0@lo:400:kworker.0 00000100:00100000:1.0:1790736289.943581:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736289.943693:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816134016 00000100:00100000:3.0:1790736289.943704:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816134016 00000100:00100000:3.0:1790736289.943760:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1790736289.943771:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606657450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+19:3306:x1877722816134016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736289.943945:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606657450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+19:3306:x1877722816134016:12345-0@lo:400:kworker.0 Request processed in 175us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736289.943954:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1790736289.944051:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816134016:0@lo:400:kworker.0 00000100:00100000:0.0:1790736289.946250:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736289.946324:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816134400 00000100:00100000:3.0:1790736289.946336:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816134400 00000100:00100000:3.0:1790736289.946420:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816134144 00000100:00100000:3.0:1790736289.946424:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816134144 00000100:00100000:3.0:1790736289.946450:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1790736289.946461:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877722816134400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736289.946546:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877722816134400:12345-0@lo:400:kworker.0 Request processed in 87us (2963us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736289.946554:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1790736289.946599:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1790736289.946605:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877722816134144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736289.946643:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877722816134144:12345-0@lo:400:kworker.0 Request processed in 38us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736289.946649:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1790736289.946763:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163380f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1877722816134400:0@lo:400:kworker.0 00000100:00100000:2.0:1790736289.947072:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736289.947337:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816134272 00000100:00100000:3.0:1790736289.947343:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816134272 00000100:00100000:3.0:1790736289.947428:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1790736289.947437:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94150133d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877722816134272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736289.947493:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94150133d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877722816134272:12345-0@lo:400:kworker.0 Request processed in 56us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736289.947500:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1790736289.947566:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1877722816134272:0@lo:400:kworker.0 00000100:00080000:0.0:1790736289.949326:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790736289.949402:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877722816134144:0@lo:400:kworker.0 00000100:00100000:2.0:1790736290.456566:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790736290.456658:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163393c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816134528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790736290.456765:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736290.456904:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816134528 00000100:00100000:0.0:1790736290.456916:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816134528 00000100:00100000:0.0:1790736290.456994:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790736290.457006:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162edc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1877722816134528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790736290.457059:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790736290.457167:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162edc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1877722816134528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 164us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736290.457177:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1790736290.457337:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790736290.457400:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163393c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816134528:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1790736290.478444:0:12535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790736290.478458:0:12535:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790736290.478509:0:12535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1790736290.478516:0:12535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1790736290.526963:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790736290.526978:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790736290.527023:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1790736290.527033:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790736290.528751:0:11704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163393c380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11704:1877722816134656:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790736290.528965:0:11704:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416120c9780 going to sleep for 11 seconds 00000100:00100000:0.0:1790736290.541193:0:11704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163393c380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11704:1877722816134656:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790736290.542015:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736290.542138:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797277184 00000100:00100000:1.0:1790736290.542148:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797277184 00000100:00100000:1.0:1790736290.542703:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 232 00000100:00100000:1.0:1790736290.542716:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+27:11598:x1877722797277184:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790736290.542771:0:5845:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790736290.542905:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+27:11598:x1877722797277184:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 191us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736290.542931:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 232 00000100:00100000:3.0:1790736290.545207:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736290.545361:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797277440 00000100:00100000:2.0:1790736290.545386:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797277440 00000100:00100000:2.0:1790736290.545454:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 233 00000100:00100000:2.0:1790736290.545466:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+27:11598:x1877722797277440:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790736290.545507:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736290.545542:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527a00/0x6aae200528fe7194 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a527129 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736290.545818:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527c00/0x6aae200528fe719b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736290.545909:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527c00/0x6aae200528fe719b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736290.545945:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527c00/0x6aae200528fe719b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790736290.545959:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1790736290.546261:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527a00/0x6aae200528fe7194 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527129 expref: 30 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736290.546283:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527c00/0x6aae200528fe719b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527129 expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736290.546294:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff941603253300) 00010000:00010000:2.0:1790736290.546297:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790736290.546302:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94163c527c00, rc 0) 00000100:00100000:2.0:1790736290.546395:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+29:11598:x1877722797277440:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 932us (1198us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1790736290.546404:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 233 00000100:00100000:2.0:1790736290.551889:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736290.552566:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797277568 00000100:00100000:3.0:1790736290.552581:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797277568 00000100:00100000:3.0:1790736290.552693:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 17 00000100:00100000:3.0:1790736290.552717:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160557e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+29:2353:x1877722797277568:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790736290.552741:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790736290.552775:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527c00/0x6aae200528fe719b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527129 expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736290.552795:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff941603253300) 00010000:00010000:3.0:1790736290.552802:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790736290.552872:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160557e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+28:2353:x1877722797277568:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 158us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736290.553172:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 17 00000100:00100000:0.0:1790736290.553227:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736290.553338:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797277824 00000100:00100000:0.0:1790736290.553752:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797277824 00000100:00100000:0.0:1790736290.553815:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 234 00000100:00100000:0.0:1790736290.553825:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163393c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+28:11598:x1877722797277824:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790736290.553949:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe71a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736290.554002:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe71a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736290.554019:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe71a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736290.556516:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe71a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736290.556536:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe71a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736290.556545:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe71a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736290.556552:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642173200 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736290.556557:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe71a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736290.556565:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe71a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736290.556584:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff941603253300) 00010000:00010000:0.0:1790736290.556588:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790736290.556593:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe71a9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736290.556600:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173200/0x6aae200528fe71a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736290.556825:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163393c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+29:11598:x1877722797277824:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 2998us (3594us total) trans 4294967517 rc 0/0 00000040:00080000:3.0:1790736290.557971:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790736290.557996:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1790736290.558223:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 234 00000040:00080000:3.0:1790736290.560831:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1790736290.560858:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790736290.561324:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736290.562132:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797278080 00000100:00100000:3.0:1790736290.562152:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797278080 00000100:00100000:3.0:1790736290.565154:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 64 00000100:00100000:3.0:1790736290.565179:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163393df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+29:11598:x1877722797278080:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790736290.565510:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163393df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+30:11598:x1877722797278080:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 340us (4197us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1790736290.565518:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 64 00010000:00010000:0.0:1790736290.582246:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790736291.032195:0:7658:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1790736291.032298:0:7658:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00010000:00010000:3.0:1790736291.605340:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790736292.502435:0:12589:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790736292.502447:0:12589:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790736292.502494:0:12589:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1790736292.502501:0:12589:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1790736292.629281:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790736292.756916:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736292.757011:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797278336 00000100:00100000:3.0:1790736292.757027:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797278336 00000100:00100000:3.0:1790736292.757232:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 235 00000100:00100000:3.0:1790736292.757246:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160838c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+30:11618:x1877722797278336:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1790736292.757282:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736292.757310:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe71b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a527130 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736292.757456:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe71b7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736292.757553:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe71b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736292.757570:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe71b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790736292.757604:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1790736292.757917:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe71b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527130 expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736292.757939:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe71b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527130 expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736292.757949:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff941603253300) 00010000:00010000:3.0:1790736292.757952:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1790736292.757955:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c9400, rc 0) 00000100:00100000:3.0:1790736292.758044:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160838c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+32:11618:x1877722797278336:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 802us (1144us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1790736292.758052:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 235 00000100:00080000:0.0:1790736292.766443:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790736292.767380:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736292.767871:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797278464 00000100:00100000:3.0:1790736292.767886:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797278464 00000100:00100000:3.0:1790736292.767971:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 236 00000100:00100000:3.0:1790736292.767984:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160838ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+32:11618:x1877722797278464:12345-192.168.203.5@tcp:54:lfs.0 00010000:00010000:3.0:1790736292.768086:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe71c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736292.768135:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe71c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736292.768220:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe71c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736292.768256:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe71c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736292.768282:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe71c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736292.768290:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe71c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736292.768296:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c8000 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736292.768301:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe71c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736292.768308:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe71c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736292.768322:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff941603253300) 00010000:00010000:3.0:1790736292.768326:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790736292.768331:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe71c5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736292.768338:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe71c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736292.768511:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160838ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+32:11618:x1877722797278464:12345-192.168.203.5@tcp:54:lfs.0 Request processed in 528us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736292.768520:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 236 00000100:00100000:1.0:1790736292.942078:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736292.946741:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797278592 00000100:00100000:0.0:1790736292.946767:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797278592 00000100:00100000:0.0:1790736292.947087:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 70 00000100:00100000:0.0:1790736292.947153:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+7:2353:x1877722797278592:12345-192.168.203.5@tcp:101:cat.0 00010000:00010000:0.0:1790736292.947178:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736292.947206:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074f72480/0x6aae200528fe71cc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a527137 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790736292.947240:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6abc77a1, atime: 0x6abc77a0, ctime: 0x6abc77a1, blocks: 0xb 00010000:00010000:0.0:1790736292.947266:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=364s v=(0 0) 00010000:00010000:0.0:1790736292.947271:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736292.947284:0:6699:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074f72480/0x6aae200528fe71cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527137 expref: 8 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736292.947624:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000074f72480/0x6aae200528fe71cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527137 expref: 8 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736292.947667:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941642173200, rc 0) 00000100:00100000:0.0:1790736292.947757:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+8:2353:x1877722797278592:12345-192.168.203.5@tcp:101:cat.0 Request processed in 607us (5687us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736292.947765:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 70 00000100:00080000:1.0:1790736292.949160:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790736292.959624:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736292.959871:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797278720 00000100:00100000:3.0:1790736292.959883:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797278720 00002000:00100000:3.0:1790736292.959940:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff94162fafc000 x1877722797278720/t0(0) o3->f945944d-9086-46a2-a91c-8bc7b88e8918@192.168.203.5@tcp:123/0 lens 488/0 e 0 to 0 dl 1790736303 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790736292.959952:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94162fafc000 with x1877722797278720 ext(0->4095) 00002000:00010000:3.0:1790736292.959973:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94162fafc000 00000100:00100000:3.0:1790736292.960011:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 7 00000100:00100000:3.0:1790736292.960181:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162fafc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+8:2356:x1877722797278720:12345-192.168.203.5@tcp:3:cat.0 00000100:00100000:3.0:1790736292.960597:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162fafc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+8:2356:x1877722797278720:12345-192.168.203.5@tcp:3:cat.0 Request processed in 575us (981us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1790736292.960606:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 7 00002000:00100000:3.0:1790736292.960613:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff94162fafc000 x1877722797278720/t0(0) o3->f945944d-9086-46a2-a91c-8bc7b88e8918@192.168.203.5@tcp:123/0 lens 488/4536 e 0 to 0 dl 1790736303 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790736292.960621:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94162fafc000 with x1877722797278720 ext(0->4095) 00002000:00010000:3.0:1790736292.960625:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94162fafc000 00010000:00010000:0.0:1790736293.654391:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1790736294.044874:0:6796:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 366055776225ns, next at 367055772693ns, rc = 0 00000100:00100000:2.0:1790736294.044907:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790736294.044936:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162fafca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816134784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790736294.045027:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736294.045209:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816134784 00000100:00100000:0.0:1790736294.045220:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816134784 00000100:00100000:0.0:1790736294.045293:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790736294.045304:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162faffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1877722816134784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790736294.045357:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790736294.045412:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162faffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1877722816134784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736294.045420:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790736294.045480:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162fafca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816134784:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790736294.045661:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1790736294.615375:0:6725:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:1.0:1790736294.615393:0:6725:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:1.0:1790736294.621210:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000020:00080000:1.0:1790736294.621244:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 6 batchid updated 00000004:00080000:1.0:1790736294.621254:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000020:00080000:1.0:1790736294.621283:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff94160875dcc0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1790736294.621289:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff941501123b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff941611ff40c0 00000020:00080000:1.0:1790736294.621292:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff941501123e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94162f520c00 00000001:00080000:1.0:1790736294.621308:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1790736294.621325:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000100:00100000:0.0:1790736294.621599:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816134912:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1790736294.621700:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1790736294.621885:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1790736294.622192:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:1.0:1790736294.624936:0:8632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816134912 00000100:00100000:1.0:1790736294.624955:0:8632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816134912 00000100:00100000:1.0:1790736294.625051:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790736294.625064:0:8632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160838e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816134912:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1790736294.625580:0:8632:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1790736294.625586:0:8632:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1790736289 -> 1790736289 00002000:00010000:1.0:1790736294.625588:0:8632:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1790736288 -> 1790736288 00002000:00010000:1.0:1790736294.625591:0:8632:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1790736289 -> 1790736289 00002000:00010000:1.0:1790736294.625593:0:8632:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1790736294.628568:0:8632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160838e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1877722816134912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3487us (6848us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1790736294.628597:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790736294.628926:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:0.0:1790736294.628934:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967323 00000100:00100000:0.0:1790736294.628965:0:3308:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94163fae1180 x1877722816134912/t4294967324(4294967324) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1790736310 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1790736294.628979:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94163fae1180/2, rc 0, transno 4294967324 00000100:00100000:0.0:1790736294.628985:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816134912:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1790736294.678469:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790736294.915581:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736294.915634:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736294.915704:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736294.915736:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736294.915763:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736294.915803:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797279360 00000100:00100000:3.0:1790736294.915816:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797279104 00000100:00100000:2.0:1790736294.915821:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797279360 00000100:00100000:3.0:1790736294.915825:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797279104 00000100:00100000:0.0:1790736294.916292:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797278848 00000100:00100000:0.0:1790736294.916303:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797278848 00000100:00100000:0.0:1790736294.916380:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 298 00000100:00100000:0.0:1790736294.916393:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941606656c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+13:2354:x1877722797278848:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1790736294.916505:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941606656c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:637df299-95a2-42b2-90c0-64260eee1701+13:2354:x1877722797278848:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 113us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736294.916515:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 298 00000100:00100000:2.0:1790736294.916762:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797278976 00000100:00100000:2.0:1790736294.916768:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797278976 00000100:00100000:3.0:1790736294.917149:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797279232 00000100:00100000:3.0:1790736294.917155:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797279232 00000100:00100000:3.0:1790736294.917202:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 92 00000100:00100000:3.0:1790736294.917212:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162faff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+7:2354:x1877722797279104:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736294.917261:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162faff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+7:2354:x1877722797279104:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 52us (1626us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736294.917268:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 92 00000100:00100000:3.0:1790736294.917285:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 93 00000100:00100000:3.0:1790736294.917292:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c520e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2354:x1877722797279232:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736294.917317:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c520e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2354:x1877722797279232:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 27us (1553us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736294.917324:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 93 00000100:00080000:3.0:1790736294.918809:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790736294.918820:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790736294.918824:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790736294.918855:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 158 00000100:00100000:3.0:1790736294.918872:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162fafca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2354:x1877722797279360:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736294.918947:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162fafca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2354:x1877722797279360:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 82us (3242us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736294.918956:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 158 00000100:00100000:2.0:1790736294.925629:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 159 00000100:00100000:2.0:1790736294.925650:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+19:2354:x1877722797278976:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1790736294.925776:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+19:2354:x1877722797278976:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 131us (10037us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736294.937580:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 159 00000100:00100000:0.0:1790736295.063831:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160312c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816135424:0@lo:400:kworker.0 00000100:00100000:0.0:1790736295.063930:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736295.064021:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790736295.064027:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816135040:0@lo:400:kworker.0 00000100:00100000:0.0:1790736295.064058:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736295.064085:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160312d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1877722816135552:0@lo:400:kworker.0 00000100:00100000:0.0:1790736295.064145:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736295.064175:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1877722816135296:0@lo:400:kworker.0 00000100:00100000:0.0:1790736295.064200:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736295.064221:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790736295.064226:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877722816135168:0@lo:400:kworker.0 00000100:00100000:0.0:1790736295.064249:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736295.064264:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b30c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816135680:0@lo:400:kworker.0 00000100:00100000:0.0:1790736295.064284:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736295.064317:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816135040 00000100:00100000:0.0:1790736295.064326:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816135040 00000100:00100000:0.0:1790736295.064402:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1790736295.064412:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94161094a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+19:3308:x1877722816135040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736295.064481:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94161094a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+19:3308:x1877722816135040:12345-0@lo:400:kworker.0 Request processed in 69us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736295.064510:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1790736295.064552:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816135552 00000100:00100000:0.0:1790736295.064556:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816135552 00000100:00100000:0.0:1790736295.064593:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816135296 00000100:00100000:0.0:1790736295.064596:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816135296 00000100:00100000:0.0:1790736295.064612:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816135168 00000100:00100000:0.0:1790736295.064615:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816135168 00000100:00100000:0.0:1790736295.064630:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1790736295.064636:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877722816135552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736295.064673:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877722816135552:12345-0@lo:400:kworker.0 Request processed in 37us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736295.064679:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1790736295.064692:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1790736295.064697:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877722816135296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736295.064728:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877722816135296:12345-0@lo:400:kworker.0 Request processed in 31us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736295.064734:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1790736295.064746:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1790736295.064751:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877722816135168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736295.064777:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877722816135168:12345-0@lo:400:kworker.0 Request processed in 26us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736295.064783:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:0.0:1790736295.064809:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790736295.064848:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877722816135168:0@lo:400:kworker.0 00000100:00100000:0.0:1790736295.064860:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1877722816135296:0@lo:400:kworker.0 00000100:00100000:0.0:1790736295.064906:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816135040:0@lo:400:kworker.0 00000100:00100000:0.0:1790736295.064916:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160312d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1877722816135552:0@lo:400:kworker.0 00000100:00100000:1.0:1790736295.065285:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816135424 00000100:00100000:1.0:1790736295.065291:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816135424 00000100:00100000:1.0:1790736295.065330:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816135680 00000100:00100000:1.0:1790736295.065349:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816135680 00000100:00100000:1.0:1790736295.065386:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790736295.065394:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1877722816135424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736295.065460:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1877722816135424:12345-0@lo:400:kworker.0 Request processed in 67us (1531us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736295.065468:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790736295.065482:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160312c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816135424:0@lo:400:kworker.0 00000100:00100000:1.0:1790736295.065482:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1790736295.065487:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b6f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816135680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736295.065530:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b6f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816135680:12345-0@lo:400:kworker.0 Request processed in 43us (1245us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736295.065536:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790736295.065613:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1790736295.065620:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1790736295.065643:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94162fafdf80, transno 4294967310 00000100:00100000:2.0:1790736295.065664:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b30c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816135680:0@lo:400:kworker.0 00000100:00080000:0.0:1790736295.065803:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790736295.573644:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b308380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816135808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790736295.573749:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736295.573896:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816135808 00000100:00100000:1.0:1790736295.573909:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816135808 00000100:00100000:1.0:1790736295.573977:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790736295.573990:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816135808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790736295.574049:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790736295.578502:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816135808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4499us (4737us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736295.578521:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790736295.588698:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b308380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816135808:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790736295.701686:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736296.726437:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736297.751660:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790736298.773517:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790736298.773531:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00010000:00010000:2.0:1790736298.773878:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790736298.774078:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1790736298.774126:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790736298.776764:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736298.778444:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797279488 00000100:00100000:0.0:1790736298.778467:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797279488 00000100:00100000:0.0:1790736298.779478:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 237 00000100:00100000:0.0:1790736298.779503:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b308380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+19:11263:x1877722797279488:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1790736298.779874:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b308380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+19:11263:x1877722797279488:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 Request processed in 383us (3121us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736298.779883:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 237 00000100:00080000:3.0:1790736298.780576:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790736298.786871:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736298.787045:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797279744 00000100:00100000:1.0:1790736298.787059:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797279744 00000100:00100000:1.0:1790736298.787203:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 65 00000100:00100000:1.0:1790736298.787223:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94150133f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+19:11263:x1877722797279744:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790736298.787706:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94150133f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+20:11263:x1877722797279744:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 483us (845us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1790736298.787715:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 65 00000100:00100000:0.0:1790736299.157509:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816135936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790736299.157614:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736299.158126:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816135936 00000100:00100000:2.0:1790736299.158139:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816135936 00000100:00100000:2.0:1790736299.158224:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790736299.158236:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160312c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1877722816135936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790736299.158358:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790736299.158475:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160312c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1877722816135936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 242us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736299.158502:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1790736299.158625:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790736299.160572:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816135936:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1790736299.761670:0:6725:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:2.0:1790736299.812670:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1790736299.812699:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1790736299.812771:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1790736299.812786:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1790736299.812879:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790736300.053645:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736300.053693:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736300.053723:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736300.053756:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736300.053793:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736300.053832:0:8632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797280128 00000100:00100000:2.0:1790736300.053845:0:8632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797280128 00000100:00100000:2.0:1790736300.053923:0:8632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797280256 00000100:00100000:2.0:1790736300.053927:0:8632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797280256 00000100:00100000:2.0:1790736300.053956:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 96 00000100:00100000:2.0:1790736300.053968:0:8632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+7:2356:x1877722797280128:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1790736300.053982:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797279872 00000100:00100000:1.0:1790736300.053987:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797279872 00000100:00100000:1.0:1790736300.054030:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 300 00000100:00100000:1.0:1790736300.054036:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94161094bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+13:2356:x1877722797279872:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1790736300.054066:0:8632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+7:2356:x1877722797280128:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 100us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736300.054066:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94161094bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+13:2356:x1877722797279872:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 29us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736300.054075:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 300 00000100:00100000:2.0:1790736300.054076:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 96 00000100:00100000:2.0:1790736300.054118:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 97 00000100:00100000:2.0:1790736300.054125:0:8632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2356:x1877722797280256:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1790736300.054151:0:8632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2356:x1877722797280256:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 27us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736300.054171:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 97 00000100:00080000:1.0:1790736300.054174:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790736300.054185:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790736300.054197:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797280000 00000100:00100000:1.0:1790736300.054201:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797280000 00000100:00100000:1.0:1790736300.054235:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797280384 00000100:00100000:1.0:1790736300.054238:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797280384 00000100:00100000:1.0:1790736300.054261:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 163 00000100:00100000:1.0:1790736300.054268:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+19:2356:x1877722797280000:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1790736300.054322:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+19:2356:x1877722797280000:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 53us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736300.054329:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 163 00000100:00100000:1.0:1790736300.054360:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 164 00000100:00100000:1.0:1790736300.054366:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2356:x1877722797280384:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1790736300.054400:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:2356:x1877722797280384:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 34us (606us total) trans 0 rc 0/0 00000100:00080000:0.0:1790736300.054513:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790736300.057006:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 164 00000100:00100000:3.0:1790736300.181988:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1877722816136320:0@lo:400:kworker.0 00000100:00100000:1.0:1790736300.181988:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94150133c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52e04a2b-4e01-44b7-985c-7db034e22389:3309:1877722816136064:0@lo:400:kworker.0 00000100:00100000:2.0:1790736300.182059:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877722816136192:0@lo:400:kworker.0 00000100:00100000:0.0:1790736300.182407:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816136448:0@lo:400:kworker.0 00000100:00100000:3.0:1790736300.182553:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736300.182651:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816136320 00000100:00100000:3.0:1790736300.182661:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816136320 00000100:00100000:3.0:1790736300.182730:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1790736300.182740:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877722816136320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736300.182807:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877722816136320:12345-0@lo:400:kworker.0 Request processed in 69us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736300.182816:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:3.0:1790736300.184359:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790736300.184424:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1877722816136320:0@lo:400:kworker.0 00000100:00100000:2.0:1790736300.190188:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736300.190278:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f7f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816136704:0@lo:400:kworker.0 00000100:00100000:2.0:1790736300.190378:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736300.190492:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816136704 00000100:00100000:2.0:1790736300.190503:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816136704 00000100:00100000:2.0:1790736300.190594:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790736300.190606:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816136704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736300.191462:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816136704:12345-0@lo:400:kworker.0 Request processed in 851us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736300.191473:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790736300.191856:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f7f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816136704:0@lo:400:kworker.0 00000100:00080000:3.0:1790736300.192085:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790736300.192134:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816136192 00000100:00100000:3.0:1790736300.192143:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816136192 00000100:00100000:3.0:1790736300.192209:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1790736300.192219:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877722816136192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736300.192286:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877722816136192:12345-0@lo:400:kworker.0 Request processed in 69us (2110us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736300.192293:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1790736300.192339:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877722816136192:0@lo:400:kworker.0 00000100:00100000:1.0:1790736300.194513:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736300.194604:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1877722816136576:0@lo:400:kworker.0 00000100:00100000:2.0:1790736300.194709:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816136064 00000100:00100000:2.0:1790736300.194719:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816136064 00000100:00100000:2.0:1790736300.194780:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1790736300.194789:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941610948c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+19:3309:x1877722816136064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736300.195340:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736300.195444:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816136576 00000100:00100000:3.0:1790736300.195451:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816136576 00000100:00100000:3.0:1790736300.195523:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1790736300.195531:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877722816136576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736300.195606:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877722816136576:12345-0@lo:400:kworker.0 Request processed in 75us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736300.195613:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1790736300.195680:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1877722816136576:0@lo:400:kworker.0 00000100:00100000:0.0:1790736300.196175:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736300.196226:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816136448 00000100:00100000:0.0:1790736300.196231:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816136448 00000100:00100000:0.0:1790736300.196267:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1790736300.196276:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160312d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816136448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736300.196330:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160312d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816136448:12345-0@lo:400:kworker.0 Request processed in 56us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736300.196355:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1790736300.196389:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1790736300.196395:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94163fae1180, transno 4294967324 00000100:00100000:0.0:1790736300.196409:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816136448:0@lo:400:kworker.0 00000100:00080000:1.0:1790736300.197131:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790736300.197361:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941610948c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+19:3309:x1877722816136064:12345-0@lo:400:kworker.0 Request processed in 2567us (2854us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736300.197375:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1790736300.197523:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94150133c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52e04a2b-4e01-44b7-985c-7db034e22389:3309:1877722816136064:0@lo:400:kworker.0 00000100:00100000:0.0:1790736300.693684:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790736300.693722:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816136832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790736300.693838:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736300.693974:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816136832 00000100:00100000:2.0:1790736300.693987:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816136832 00000100:00100000:2.0:1790736300.694061:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790736300.694075:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816136832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790736300.694424:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790736300.694501:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816136832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 428us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736300.694510:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790736300.694623:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816136832:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790736300.823586:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790736301.265049:0:12793:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 22:44:59 (1790736299) 00010000:00010000:2.0:1790736301.845411:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736302.869329:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736303.893834:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790736303.934426:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736303.935197:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797280512 00000100:00100000:3.0:1790736303.935210:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797280512 00000100:00100000:3.0:1790736303.935302:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 238 00000100:00100000:3.0:1790736303.935314:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+5:12282:x1877722797280512:12345-192.168.203.5@tcp:101:lsof.0 00010000:00010000:3.0:1790736303.935337:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736303.935376:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe71d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a52713e expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736303.935444:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe71da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736303.935461:0:8114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe71da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736303.935472:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe71da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790736303.935506:0:8114:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790736303.935510:0:8114:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790736303.935548:0:8114:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe71da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736303.935572:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9800/0x6aae200528fe71d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52713e expref: 7 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736303.935601:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe71da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52713e expref: 6 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736303.935611:0:8114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff941605242d00) 00010000:00010000:3.0:1790736303.935615:0:8114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790736303.935618:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c8000, rc 0) 00000100:00080000:1.0:1790736303.935765:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790736303.935877:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+6:12282:x1877722797280512:12345-192.168.203.5@tcp:101:lsof.0 Request processed in 564us (1462us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736303.935885:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 238 00000100:00100000:3.0:1790736304.278247:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790736304.278293:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f265f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816136960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790736304.278363:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736304.278726:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816136960 00000100:00100000:1.0:1790736304.278735:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816136960 00000100:00100000:1.0:1790736304.278799:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790736304.278808:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816136960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790736304.278843:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790736304.278906:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816136960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736304.278914:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1790736304.279310:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790736304.279389:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f265f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816136960:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790736304.917534:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736305.154636:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736305.154682:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736305.154720:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736305.154758:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736305.154831:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736305.154864:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797281152 00000100:00100000:3.0:1790736305.154874:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797281152 00000100:00100000:3.0:1790736305.154992:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797280768 00000100:00100000:3.0:1790736305.154997:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797280768 00000100:00100000:3.0:1790736305.155025:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 168 00000100:00100000:3.0:1790736305.155035:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94150133c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+6:2356:x1877722797281152:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736305.155137:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94150133c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+6:2356:x1877722797281152:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 103us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736305.155145:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 168 00000100:00100000:3.0:1790736305.155162:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 169 00000100:00100000:3.0:1790736305.155168:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+19:2356:x1877722797280768:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736305.155196:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+19:2356:x1877722797280768:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 27us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736305.155201:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 169 00000100:00080000:3.0:1790736305.155216:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790736305.155353:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797280896 00000100:00100000:2.0:1790736305.155359:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797280896 00000100:00100000:2.0:1790736305.155402:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797281024 00000100:00100000:2.0:1790736305.155406:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797281024 00000100:00100000:2.0:1790736305.155426:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 100 00000100:00100000:2.0:1790736305.155433:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f7f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+7:2356:x1877722797280896:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1790736305.155462:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f7f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+7:2356:x1877722797280896:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 30us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736305.155469:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 100 00000100:00100000:2.0:1790736305.155481:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 101 00000100:00100000:2.0:1790736305.155487:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2356:x1877722797281024:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1790736305.155512:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2356:x1877722797281024:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 25us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736305.155518:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 101 00000100:00100000:0.0:1790736305.155697:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797280640 00000100:00100000:0.0:1790736305.155702:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797280640 00000100:00100000:0.0:1790736305.155741:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 302 00000100:00100000:0.0:1790736305.155748:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94161094b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+13:2356:x1877722797280640:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1790736305.155780:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94161094b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:637df299-95a2-42b2-90c0-64260eee1701+13:2356:x1877722797280640:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 33us (1154us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736305.155788:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 302 00000100:00080000:3.0:1790736305.156090:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790736305.156124:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790736305.301489:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633801c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1877722816137344:0@lo:400:kworker.0 00000100:00100000:3.0:1790736305.301565:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736305.301646:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1790736305.301654:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877722816137216:0@lo:400:kworker.0 00000100:00100000:3.0:1790736305.301680:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736305.301699:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633802680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816137728:0@lo:400:kworker.0 00000100:00100000:3.0:1790736305.301724:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736305.301761:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816137344 00000100:00100000:3.0:1790736305.301769:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816137344 00000100:00100000:3.0:1790736305.301825:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816137216 00000100:00100000:3.0:1790736305.301829:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816137216 00000100:00100000:3.0:1790736305.301847:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1790736305.301856:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633802300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877722816137344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736305.301910:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633802300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877722816137344:12345-0@lo:400:kworker.0 Request processed in 54us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736305.301917:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1790736305.301934:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1790736305.301940:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633800a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877722816137216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736305.301967:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633800a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877722816137216:12345-0@lo:400:kworker.0 Request processed in 28us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736305.301973:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:3.0:1790736305.301990:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790736305.302021:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877722816137216:0@lo:400:kworker.0 00000100:00100000:3.0:1790736305.302033:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633801c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1877722816137344:0@lo:400:kworker.0 00000100:00100000:2.0:1790736305.302141:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816137728 00000100:00100000:2.0:1790736305.302146:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816137728 00000100:00100000:2.0:1790736305.302185:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1790736305.302193:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816137728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736305.302237:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816137728:12345-0@lo:400:kworker.0 Request processed in 45us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736305.302244:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1790736305.302283:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633802680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816137728:0@lo:400:kworker.0 00000100:00100000:1.0:1790736305.302412:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52e04a2b-4e01-44b7-985c-7db034e22389:3309:1877722816137088:0@lo:400:kworker.0 00000100:00100000:1.0:1790736305.302448:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736305.302486:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633800e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1877722816137600:0@lo:400:kworker.0 00000100:00100000:1.0:1790736305.302509:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736305.302527:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790736305.302542:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816137472:0@lo:400:kworker.0 00000100:00100000:1.0:1790736305.302568:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736305.302594:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816137472 00000100:00100000:1.0:1790736305.302598:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816137472 00000100:00100000:1.0:1790736305.302626:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790736305.302633:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162fafdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816137472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736305.302670:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162fafdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816137472:12345-0@lo:400:kworker.0 Request processed in 37us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736305.302676:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790736305.302696:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816137600 00000100:00100000:1.0:1790736305.302700:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816137600 00000100:00100000:1.0:1790736305.302724:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1790736305.302730:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b30c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877722816137600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736305.302760:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b30c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877722816137600:12345-0@lo:400:kworker.0 Request processed in 30us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736305.302765:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1790736305.302789:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816137472:0@lo:400:kworker.0 00000100:00100000:1.0:1790736305.302798:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633800e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1877722816137600:0@lo:400:kworker.0 00000100:00100000:2.0:1790736305.302869:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816137088 00000100:00100000:2.0:1790736305.302874:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816137088 00000100:00100000:2.0:1790736305.302916:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1790736305.302923:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94161094b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+19:3309:x1877722816137088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736305.302958:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94161094b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52e04a2b-4e01-44b7-985c-7db034e22389+19:3309:x1877722816137088:12345-0@lo:400:kworker.0 Request processed in 36us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736305.302963:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00080000:3.0:1790736305.303321:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790736305.303325:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790736305.303438:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52e04a2b-4e01-44b7-985c-7db034e22389:3309:1877722816137088:0@lo:400:kworker.0 00000100:00100000:3.0:1790736305.813489:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816137856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790736305.813714:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736305.818110:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816137856 00000100:00100000:1.0:1790736305.818131:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816137856 00000100:00100000:1.0:1790736305.818194:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790736305.818204:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633801c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816137856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790736305.818245:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790736305.818352:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633801c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816137856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 148us (4707us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736305.818372:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790736305.818626:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816137856:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790736305.941393:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736306.066964:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736306.067132:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797281408 00000100:00100000:1.0:1790736306.067142:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797281408 00000100:00100000:1.0:1790736306.067198:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 66 00000100:00100000:1.0:1790736306.067208:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633801880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+19:12283:x1877722797281408:12345-192.168.203.5@tcp:35:umount.0 00000100:00100000:1.0:1790736306.067875:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633801880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+20:12283:x1877722797281408:12345-192.168.203.5@tcp:35:umount.0 Request processed in 666us (918us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1790736306.067884:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 66 00000100:00100000:0.0:1790736306.077690:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736306.077773:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797281664 00000100:00100000:3.0:1790736306.077784:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797281664 00000100:00100000:3.0:1790736306.077853:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 67 00000100:00100000:3.0:1790736306.077864:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+20:12283:x1877722797281664:12345-192.168.203.5@tcp:35:umount.0 00000100:00100000:3.0:1790736306.078276:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+21:12283:x1877722797281664:12345-192.168.203.5@tcp:35:umount.0 Request processed in 407us (602us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1790736306.078284:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 67 00000100:00100000:2.0:1790736306.089761:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736306.089923:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797281920 00000100:00100000:0.0:1790736306.089934:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797281920 00000100:00100000:0.0:1790736306.089990:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 68 00000100:00100000:0.0:1790736306.090001:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416114ef850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+21:12283:x1877722797281920:12345-192.168.203.5@tcp:35:umount.0 00000100:00100000:0.0:1790736306.090242:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416114ef850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+22:12283:x1877722797281920:12345-192.168.203.5@tcp:35:umount.0 Request processed in 242us (489us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1790736306.090271:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 68 00000100:00100000:2.0:1790736306.093528:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736306.095489:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797282176 00000100:00100000:0.0:1790736306.095504:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797282176 00000100:00100000:0.0:1790736306.095736:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 69 00000100:00100000:0.0:1790736306.095748:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+22:12283:x1877722797282176:12345-192.168.203.5@tcp:35:umount.0 00000100:00100000:0.0:1790736306.096166:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+23:12283:x1877722797282176:12345-192.168.203.5@tcp:35:umount.0 Request processed in 418us (2646us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1790736306.096174:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 69 00000100:00100000:2.0:1790736306.102800:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736306.102836:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736306.102862:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736306.102902:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736306.102930:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797282688 00000100:00100000:2.0:1790736306.102940:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797282688 00000100:00100000:1.0:1790736306.102941:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797282304 00000100:00100000:1.0:1790736306.102945:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797282304 00000100:00100000:1.0:1790736306.102983:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797282560 00000100:00100000:2.0:1790736306.102986:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 72 00000100:00100000:1.0:1790736306.102986:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797282560 00000100:00100000:2.0:1790736306.102995:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2352:x1877722797282688:12345-192.168.203.5@tcp:9:umount.0 00000100:00100000:1.0:1790736306.102998:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797282432 00000100:00100000:1.0:1790736306.103000:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797282432 00000100:00100000:1.0:1790736306.103012:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18 00000100:00100000:1.0:1790736306.103018:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f267480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:637df299-95a2-42b2-90c0-64260eee1701+15:2355:x1877722797282304:12345-192.168.203.5@tcp:103:ldlm_bl.0 00000020:00000080:2.0:1790736306.103022:0:6698:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6aae200528fe6538 00010000:00010000:1.0:1790736306.103028:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:2.0:1790736306.103030:0:6698:0:(import.c:65:import_set_state_nolock()) ffff941604d93800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1790736306.103044:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941600031e00/0x6aae200528fe6260 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526cd0 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736306.103059:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00000004:2.0:1790736306.103064:0:6698:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1790736306.103126:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f267480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:637df299-95a2-42b2-90c0-64260eee1701+14:2355:x1877722797282304:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 107us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736306.103133:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18 00000100:00100000:1.0:1790736306.103281:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 19 00000100:00100000:1.0:1790736306.103289:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f267b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:637df299-95a2-42b2-90c0-64260eee1701+13:2355:x1877722797282560:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790736306.103323:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790736306.103333:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f945944d-9086-46a2-a91c-8bc7b88e8918+2:2352:x1877722797282688:12345-192.168.203.5@tcp:9:umount.0 Request processed in 339us (430us total) trans 0 rc 0/0 00010000:00010000:1.0:1790736306.103333:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941611930800/0x6aae200528fe6474 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d9b expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736306.103340:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 72 00010000:00010000:1.0:1790736306.103343:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790736306.103360:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f267b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:637df299-95a2-42b2-90c0-64260eee1701+12:2355:x1877722797282560:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 72us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736306.103366:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 19 00000100:00100000:1.0:1790736306.103378:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 20 00000100:00100000:1.0:1790736306.103384:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f264700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:637df299-95a2-42b2-90c0-64260eee1701+11:2355:x1877722797282432:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790736306.103391:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736306.103400:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94162156e800/0x6aae200528fe61c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526c98 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736306.103408:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790736306.103931:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736306.104385:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f264700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:637df299-95a2-42b2-90c0-64260eee1701+10:2355:x1877722797282432:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 997us (1518us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736306.104395:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 20 00000100:00100000:2.0:1790736306.112161:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736306.112309:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797283072 00000100:00100000:1.0:1790736306.112329:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797283072 00000100:00100000:1.0:1790736306.112387:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 73 00000100:00100000:1.0:1790736306.112395:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+7:2352:x1877722797283072:12345-192.168.203.5@tcp:9:umount.0 00000020:00000080:1.0:1790736306.112440:0:6697:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6aae200528fe67a0 00000020:00010000:1.0:1790736306.112450:0:6697:0:(genops.c:1920:obd_stale_export_put()) Put export ffff94162a7c6800: total 0 00000100:00080000:1.0:1790736306.112454:0:6697:0:(import.c:65:import_set_state_nolock()) ffff94162a7c1800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790736306.112491:0:6697:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1790736306.112787:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f945944d-9086-46a2-a91c-8bc7b88e8918+5:2352:x1877722797283072:12345-192.168.203.5@tcp:9:umount.0 Request processed in 390us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736306.112821:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 73 00000020:00010000:2.0:1790736306.113371:0:5832:0:(genops.c:1906:obd_stale_export_get()) Get export ffff94162a7c6800: total 0 00010000:00010000:2.0:1790736306.113401:0:5832:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff94162a7c6800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1790736306.113452:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a196d76d/0x6aae200528fe6b3c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f70 expref: 4 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736306.113505:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074f72480/0x6aae200528fe71cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527137 expref: 3 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736306.113521:0:5832:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff94162a7c6800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1790736306.113547:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736306.113549:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736306.113551:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790736306.130575:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736306.130688:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797284096 00000100:00100000:0.0:1790736306.130696:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797284096 00000100:00100000:0.0:1790736306.130764:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 239 00000100:00100000:0.0:1790736306.130773:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+23:2352:x1877722797284096:12345-192.168.203.5@tcp:39:umount.0 00000020:00000080:0.0:1790736306.130812:0:5845:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6aae200528fe61d4 00000020:00010000:0.0:1790736306.130829:0:5845:0:(genops.c:1920:obd_stale_export_put()) Put export ffff94162f89f000: total 0 00000100:00080000:0.0:1790736306.130833:0:5845:0:(import.c:65:import_set_state_nolock()) ffff9416181ac000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790736306.130862:0:5845:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:0.0:1790736306.131433:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f945944d-9086-46a2-a91c-8bc7b88e8918+22:2352:x1877722797284096:12345-192.168.203.5@tcp:39:umount.0 Request processed in 658us (864us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1790736306.131442:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 239 00000020:00010000:2.0:1790736306.131712:0:5831:0:(genops.c:1906:obd_stale_export_get()) Get export ffff94162f89f000: total 0 00010000:00010000:2.0:1790736306.131751:0:5831:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff94162f89f000, canceled 0 locks, left on hash table 14. 00010000:00010000:2.0:1790736306.131782:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94161505d100) 00010000:00010000:2.0:1790736306.131785:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790736306.131804:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8800/0x6aae200528fe67fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526e97 expref: 21 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736306.131824:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff941603253400) 00010000:00010000:2.0:1790736306.131826:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790736306.131831:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61000/0x6aae200528fe649e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526da9 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736306.131851:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff941605242d00) 00010000:00010000:2.0:1790736306.131853:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790736306.131857:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9416013ff600/0x6aae200528fe6b90 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f85 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736306.131871:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff941603253300) 00010000:00010000:2.0:1790736306.131885:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790736306.131890:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9400/0x6aae200528fe71b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527130 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736306.131906:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff941603253d00) 00010000:00010000:2.0:1790736306.131909:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790736306.131913:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8400/0x6aae200528fe6a1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f23 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736306.132041:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff941603253d00) 00010000:00010000:2.0:1790736306.132044:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790736306.132049:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8c00/0x6aae200528fe6b19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f62 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736306.132061:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff941603253300) 00010000:00010000:2.0:1790736306.132064:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790736306.132067:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c526c00/0x6aae200528fe718d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527122 expref: 15 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736306.132078:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94161505d100) 00010000:00010000:2.0:1790736306.132080:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1790736306.132083:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9200/0x6aae200528fe650e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526dc5 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736306.132397:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94160678a900) 00010000:00010000:2.0:1790736306.132401:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790736306.132405:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611930000/0x6aae200528fe64ba lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526db0 expref: 13 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736306.132447:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94161505de00) 00010000:00010000:2.0:1790736306.132450:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790736306.132455:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe6e8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52705e expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736306.132466:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff941603253d00) 00010000:00010000:2.0:1790736306.132469:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790736306.132472:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9000/0x6aae200528fe6b27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f69 expref: 11 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736306.132482:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff941603253300) 00010000:00010000:2.0:1790736306.132484:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790736306.132487:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163c527200/0x6aae200528fe70ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5270ea expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736306.132502:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94161505de00) 00010000:00010000:2.0:1790736306.132504:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1790736306.132508:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c9a00/0x6aae200528fe6bac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f8c expref: 9 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736306.132520:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff941603253d00) 00010000:00010000:2.0:1790736306.132523:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790736306.132526:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941642173600/0x6aae200528fe6aef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526f5b expref: 8 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736306.132538:0:5831:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff94162f89f000, canceled 14 locks, left on hash table 0. 00010000:00010000:2.0:1790736306.132554:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736306.132562:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736306.132564:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790736306.418795:0:7658:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f945944d-9086-46a2-a91c-8bc7b88e8918 00000020:00000080:3.0:1790736306.418804:0:7658:0:(genops.c:885:class_export_put()) final put ffff941604d94800/f945944d-9086-46a2-a91c-8bc7b88e8918 00000020:00000080:1.0:1790736306.418876:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff941604d94800/f945944d-9086-46a2-a91c-8bc7b88e8918 for lustre-OST0001 00000020:00000080:1.0:1790736306.418928:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff941604d93800 for lustre-OST0001 00010000:00010000:3.0:1790736306.965276:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736307.994969:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736308.610283:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736308.610328:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736308.610366:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736308.610596:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797284224 00000100:00100000:1.0:1790736308.610606:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797284224 00000100:00100000:1.0:1790736308.610669:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797284480 00000100:00100000:1.0:1790736308.610672:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797284480 00000100:00100000:1.0:1790736308.610685:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797284352 00000100:00100000:1.0:1790736308.610688:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797284352 00000100:00100000:1.0:1790736308.610703:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 21 00000100:00100000:1.0:1790736308.610712:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633800000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:637df299-95a2-42b2-90c0-64260eee1701+12:2356:x1877722797284224:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790736308.610736:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736308.610756:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941600031200/0x6aae200528fe62a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526ce5 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736308.610775:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790736308.610824:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633800000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:637df299-95a2-42b2-90c0-64260eee1701+11:2356:x1877722797284224:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 113us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736308.610831:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 21 00000100:00100000:1.0:1790736308.610848:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 22 00000100:00100000:1.0:1790736308.610854:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633803480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:637df299-95a2-42b2-90c0-64260eee1701+10:2356:x1877722797284480:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790736308.610862:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736308.610870:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941633c61e00/0x6aae200528fe646d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d94 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736308.610878:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790736308.610893:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633803480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:637df299-95a2-42b2-90c0-64260eee1701+9:2356:x1877722797284480:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 40us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736308.610911:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 22 00000100:00100000:1.0:1790736308.610923:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 23 00000100:00100000:1.0:1790736308.610929:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633803b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:637df299-95a2-42b2-90c0-64260eee1701+8:2356:x1877722797284352:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790736308.610936:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736308.610944:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941633c60000/0x6aae200528fe62ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526d0f expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736308.610953:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790736308.610971:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633803b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:637df299-95a2-42b2-90c0-64260eee1701+7:2356:x1877722797284352:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 42us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736308.610977:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 23 00000100:00100000:3.0:1790736308.621064:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736308.621211:0:8114:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797284736 00000100:00100000:1.0:1790736308.621222:0:8114:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797284736 00000100:00100000:1.0:1790736308.621317:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 240 00000100:00100000:1.0:1790736308.621328:0:8114:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+6:2352:x1877722797284736:12345-192.168.203.5@tcp:39:umount.0 00000020:00000080:1.0:1790736308.621370:0:8114:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6aae200528fe62bb 00000020:00010000:1.0:1790736308.621377:0:8114:0:(genops.c:1920:obd_stale_export_put()) Put export ffff941633c51000: total 0 00000100:00080000:1.0:1790736308.621382:0:8114:0:(import.c:65:import_set_state_nolock()) ffff941633c50000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790736308.621413:0:8114:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:0.0:1790736308.621497:0:5831:0:(genops.c:1906:obd_stale_export_get()) Get export ffff941633c51000: total 0 00010000:00010000:0.0:1790736308.621502:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736308.621541:0:5831:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff941633c51000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1790736308.621571:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff941605242d00) 00010000:00010000:0.0:1790736308.621575:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790736308.621584:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162f8c8000/0x6aae200528fe71da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52713e expref: 7 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736308.621629:0:5831:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff941633c51000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1790736308.621639:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736308.621642:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736308.621643:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736308.621652:0:8114:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af+3:2352:x1877722797284736:12345-192.168.203.5@tcp:39:umount.0 Request processed in 326us (597us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1790736308.621661:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 240 00000100:00080000:3.0:1790736308.622172:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790736308.650293:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736308.650390:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797284992 00000100:00100000:3.0:1790736308.650400:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797284992 00000100:00100000:3.0:1790736308.650457:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 304 00000100:00100000:3.0:1790736308.650468:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94161094a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+7:2352:x1877722797284992:12345-192.168.203.5@tcp:251:umount.0 00000020:00000080:3.0:1790736308.650512:0:5836:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6aae200528fe61b1 00000020:00010000:3.0:1790736308.650519:0:5836:0:(genops.c:1920:obd_stale_export_put()) Put export ffff941603181000: total 0 00000100:00080000:3.0:1790736308.650524:0:5836:0:(import.c:65:import_set_state_nolock()) ffff941603184000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1790736308.650616:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94161094a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:637df299-95a2-42b2-90c0-64260eee1701+3:2352:x1877722797284992:12345-192.168.203.5@tcp:251:umount.0 Request processed in 150us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736308.650623:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 304 00000020:00010000:0.0:1790736308.650792:0:11186:0:(genops.c:1906:obd_stale_export_get()) Get export ffff941603181000: total 0 00010000:00010000:0.0:1790736308.650831:0:11186:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff941603181000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1790736308.650862:0:11186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94162156ec00/0x6aae200528fe6267 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0x92962417a526cd7 expref: 2 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736308.650876:0:11186:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff941603181000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1790736308.650885:0:11186:0:(genops.c:885:class_export_put()) final put ffff941603181000/637df299-95a2-42b2-90c0-64260eee1701 00010000:00010000:0.0:1790736308.650902:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736308.650904:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736308.650906:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790736308.652436:0:12664:0:(genops.c:844:class_export_destroy()) destroying export ffff941603181000/637df299-95a2-42b2-90c0-64260eee1701 for MGS 00000020:00000080:3.0:1790736308.652512:0:12664:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff941603184000 for MGS 00000040:00080000:1.0:1790736309.013460:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790736309.013473:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790736309.013947:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1790736309.013958:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1790736309.016896:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736309.397432:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790736309.397464:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816137984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790736309.397560:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736309.397795:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816137984 00000100:00100000:2.0:1790736309.397806:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816137984 00000100:00100000:2.0:1790736309.397953:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790736309.397966:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816137984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790736309.398017:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790736309.398079:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816137984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736309.398087:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1790736309.398182:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790736309.398243:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816137984:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1790736309.992641:0:5867:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f945944d-9086-46a2-a91c-8bc7b88e8918 00000001:00080000:0.0:1790736309.992656:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:0.0:1790736309.992667:0:5867:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af 00000001:00080000:0.0:1790736309.992673:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1790736309.992676:0:5867:0:(genops.c:885:class_export_put()) final put ffff941633c51000/d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af 00000020:00000080:0.0:1790736309.992691:0:5867:0:(genops.c:885:class_export_put()) final put ffff94162f89f000/f945944d-9086-46a2-a91c-8bc7b88e8918 00000020:00000080:0.0:1790736309.992721:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff941633c51000/d8f13f8e-c3f5-4492-8ba0-d8e6bcad83af for lustre-MDT0000 00000020:00000080:0.0:1790736309.992765:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff94162f89f000/f945944d-9086-46a2-a91c-8bc7b88e8918 for lustre-MDT0000 00000020:00000080:0.0:1790736309.992790:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff941633c50000 for lustre-MDT0000 00000020:00000080:0.0:1790736309.992794:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9416181ac000 for lustre-MDT0000 00000001:00100000:2.0:1790736310.003443:0:6725:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f945944d-9086-46a2-a91c-8bc7b88e8918 00000020:00000080:2.0:1790736310.003452:0:6725:0:(genops.c:885:class_export_put()) final put ffff94162a7c6800/f945944d-9086-46a2-a91c-8bc7b88e8918 00000020:00000080:0.0:1790736310.004917:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94162a7c6800/f945944d-9086-46a2-a91c-8bc7b88e8918 for lustre-OST0000 00000020:00000080:2.0:1790736310.005114:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94162a7c1800 for lustre-OST0000 00010000:00010000:0.0:1790736310.037515:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790736310.423462:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1877722816138368:0@lo:400:kworker.0 00000100:00100000:2.0:1790736310.423537:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736310.423616:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790736310.423624:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877722816138240:0@lo:400:kworker.0 00000100:00100000:2.0:1790736310.423647:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736310.423663:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816138752:0@lo:400:kworker.0 00000100:00100000:2.0:1790736310.423686:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736310.423723:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816138368 00000100:00100000:2.0:1790736310.423730:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816138368 00000100:00100000:2.0:1790736310.423777:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816138240 00000100:00100000:2.0:1790736310.423780:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816138240 00000100:00100000:2.0:1790736310.423801:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1790736310.423825:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877722816138368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736310.423881:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877722816138368:12345-0@lo:400:kworker.0 Request processed in 57us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736310.423888:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1790736310.423904:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1790736310.423910:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877722816138240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736310.423935:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877722816138240:12345-0@lo:400:kworker.0 Request processed in 26us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736310.423940:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1790736310.423956:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816138752 00000100:00100000:2.0:1790736310.423960:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816138752 00000100:00100000:2.0:1790736310.423984:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1790736310.423991:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816138752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736310.424019:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816138752:12345-0@lo:400:kworker.0 Request processed in 30us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736310.424025:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1790736310.424064:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877722816138240:0@lo:400:kworker.0 00000100:00100000:2.0:1790736310.424074:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816138752:0@lo:400:kworker.0 00000100:00100000:2.0:1790736310.424084:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1877722816138368:0@lo:400:kworker.0 00000100:00100000:1.0:1790736310.424202:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816138496:0@lo:400:kworker.0 00000100:00100000:1.0:1790736310.424245:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736310.424275:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790736310.424281:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816138112:0@lo:400:kworker.0 00000100:00100000:1.0:1790736310.424309:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736310.424340:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1877722816138624:0@lo:400:kworker.0 00000100:00100000:1.0:1790736310.424363:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736310.424388:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816138624 00000100:00100000:1.0:1790736310.424392:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816138624 00000100:00100000:1.0:1790736310.424418:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1790736310.424424:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877722816138624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736310.424458:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877722816138624:12345-0@lo:400:kworker.0 Request processed in 34us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736310.424464:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1790736310.424492:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1877722816138624:0@lo:400:kworker.0 00000100:00080000:3.0:1790736310.424577:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790736310.424581:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790736310.424708:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816138496 00000100:00100000:0.0:1790736310.424720:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816138496 00000100:00100000:0.0:1790736310.424754:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1790736310.424761:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633e84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816138496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736310.424802:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633e84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816138496:12345-0@lo:400:kworker.0 Request processed in 43us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736310.424808:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1790736310.424868:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816138496:0@lo:400:kworker.0 00000100:00100000:2.0:1790736310.424954:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816138112 00000100:00100000:2.0:1790736310.424959:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816138112 00000100:00100000:2.0:1790736310.424987:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1790736310.424993:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941610948050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+19:3308:x1877722816138112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736310.425031:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941610948050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52e04a2b-4e01-44b7-985c-7db034e22389+19:3308:x1877722816138112:12345-0@lo:400:kworker.0 Request processed in 39us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736310.425044:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1790736310.425118:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816138112:0@lo:400:kworker.0 00000020:01000004:2.0:1790736310.673643:0:12994:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1790736310.701455:0:12994:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1790736310.701506:0:12994:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff941611931400/0x6aae200528fe6236 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe623d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736310.701521:0:12994:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff941611931400/0x6aae200528fe6236 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe623d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736310.701528:0:12994:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff941611931400/0x6aae200528fe6236 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x6aae200528fe623d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736310.701535:0:12994:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.105@tcp lock: ffff941611931400/0x6aae200528fe6236 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x6aae200528fe623d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736310.701554:0:12994:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790736310.701560:0:12994:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1790736310.701580:0:12994:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790736310.701585:0:12994:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1790736310.701590:0:12994:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790736310.701614:0:12994:0:(import.c:65:import_set_state_nolock()) ffff94162a68b000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1790736310.701846:0:11186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790736310.701852:0:11186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff941611931400/0x6aae200528fe6236 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x6aae200528fe623d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736310.701860:0:11186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941611931400 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:0.0:1790736310.701863:0:11186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff941611931400/0x6aae200528fe6236 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x6aae200528fe623d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736310.701872:0:11186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff941611931400/0x6aae200528fe6236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x6aae200528fe623d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790736310.701879:0:11186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff941611931400/0x6aae200528fe6236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x6aae200528fe623d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790736310.701884:0:11186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790736310.701887:0:11186:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1790736310.701889:0:11186:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1790736310.701920:0:11186:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff941611931400/0x6aae200528fe6236 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6aae200528fe623d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736310.701926:0:11186:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790736310.701959:0:11186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff941611931400/0x6aae200528fe6236 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6aae200528fe623d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736310.701965:0:11186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff941611931400/0x6aae200528fe6236 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6aae200528fe623d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736310.701989:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736310.701991:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736310.701993:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736310.702051:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790736310.702068:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816139008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790736310.702168:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736310.702400:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816139008 00000100:00100000:0.0:1790736310.702407:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816139008 00000100:00100000:0.0:1790736310.702450:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790736310.702459:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160557fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52e04a2b-4e01-44b7-985c-7db034e22389+19:3306:x1877722816139008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790736310.702473:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790736310.702488:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941600031a00/0x6aae200528fe623d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6aae200528fe6236 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736310.702501:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790736310.702545:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160557fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52e04a2b-4e01-44b7-985c-7db034e22389+18:3306:x1877722816139008:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736310.702552:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790736310.702638:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52e04a2b-4e01-44b7-985c-7db034e22389:3306:1877722816139008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790736310.702723:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877722816138880:0@lo:39:umount.0 00000100:00100000:1.0:1790736310.702764:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736310.702841:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816138880 00000100:00100000:3.0:1790736310.702846:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816138880 00000100:00100000:3.0:1790736310.702886:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1790736310.702893:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877722816138880:12345-0@lo:39:umount.0 00000020:00000080:3.0:1790736310.702919:0:5844:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6aae200528fe5fc0 00000100:00080000:3.0:1790736310.702928:0:5844:0:(import.c:65:import_set_state_nolock()) ffff941606686000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1790736310.702982:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3305:x1877722816138880:12345-0@lo:39:umount.0 Request processed in 89us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736310.702988:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:3.0:1790736310.702994:0:5844:0:(genops.c:885:class_export_put()) final put ffff941606683800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1790736310.703020:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790736310.703029:0:12664:0:(genops.c:844:class_export_destroy()) destroying export ffff941606683800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1790736310.703173:0:12664:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff941606686000 for lustre-MDT0000 00000100:00080000:1.0:1790736310.703495:0:3305:0:(import.c:65:import_set_state_nolock()) ffff94162a68b000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1790736310.703513:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877722816138880:0@lo:39:umount.0 00000100:00080000:2.0:1790736310.703578:0:12994:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790736310.703581:0:12994:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790736310.703586:0:12994:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1790736310.705737:0:12994:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c8200/0x6aae200528fe6244 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe624b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736310.705756:0:12994:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c8200/0x6aae200528fe6244 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe624b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736310.705782:0:12994:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c8200/0x6aae200528fe6244 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x6aae200528fe624b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736310.705790:0:12994:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.105@tcp lock: ffff94162f8c8200/0x6aae200528fe6244 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x6aae200528fe624b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736310.705809:0:12994:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790736310.705815:0:12994:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff941600031c00/0x6aae200528fe616b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6172 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736310.705821:0:12994:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff941600031c00/0x6aae200528fe616b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe6172 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736310.705828:0:12994:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff941600031c00/0x6aae200528fe616b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6aae200528fe6172 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736310.705834:0:12994:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.105@tcp lock: ffff941600031c00/0x6aae200528fe616b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6aae200528fe6172 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736310.705854:0:12994:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790736310.705861:0:12994:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff941633c61a00/0x6aae200528fe645f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6466 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736310.705867:0:12994:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff941633c61a00/0x6aae200528fe645f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe6466 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736310.705874:0:12994:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff941633c61a00/0x6aae200528fe645f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6aae200528fe6466 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736310.705891:0:12994:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.105@tcp lock: ffff941633c61a00/0x6aae200528fe645f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6aae200528fe6466 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736310.705904:0:12994:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1790736310.705910:0:12994:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff941642172400/0x6aae200528fe5f1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe5f26 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736310.705917:0:12994:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff941642172400/0x6aae200528fe5f1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe5f26 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736310.705923:0:12994:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff941642172400/0x6aae200528fe5f1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6aae200528fe5f26 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736310.705929:0:12994:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.105@tcp lock: ffff941642172400/0x6aae200528fe5f1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6aae200528fe5f26 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736310.705937:0:12994:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1790736310.705940:0:12994:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1790736310.705963:0:12994:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1790736310.705967:0:12994:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1790736310.705971:0:12994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790736310.705976:0:12994:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1790736310.705983:0:12994:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff94162f89c000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790736310.705989:0:12994:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff94163fa04800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790736310.705994:0:12994:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff94160837cd40) has exports, disconnecting them 00000020:00080000:2.0:1790736310.705999:0:12994:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff94162f89c000), last request at 1790736310 00000020:00000080:2.0:1790736310.706007:0:12994:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6aae200528fe6133 00000100:00080000:2.0:1790736310.706026:0:12994:0:(import.c:65:import_set_state_nolock()) ffff94162f89b800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1790736310.706072:0:12994:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff94162f89c000): rc 0 00010000:00010000:1.0:1790736310.706341:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1790736310.706349:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff94162f8c8200/0x6aae200528fe6244 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x6aae200528fe624b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736310.706357:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c8200 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:1.0:1790736310.706368:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff94162f8c8200/0x6aae200528fe6244 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x6aae200528fe624b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736310.706378:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff94162f8c8200/0x6aae200528fe6244 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x6aae200528fe624b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790736310.706386:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff94162f8c8200/0x6aae200528fe6244 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x6aae200528fe624b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790736310.706393:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790736310.706395:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1790736310.706398:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1790736310.706426:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff94162f8c8200/0x6aae200528fe6244 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6aae200528fe624b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736310.706434:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790736310.706456:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff94162f8c8200/0x6aae200528fe6244 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6aae200528fe624b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736310.706464:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff94162f8c8200/0x6aae200528fe6244 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6aae200528fe624b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736310.706475:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790736310.706478:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff941600031c00/0x6aae200528fe616b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6aae200528fe6172 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736310.706483:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941600031c00 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:1.0:1790736310.706487:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff941600031c00/0x6aae200528fe616b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6aae200528fe6172 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736310.706494:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff941600031c00/0x6aae200528fe616b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6aae200528fe6172 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790736310.706506:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff941600031c00/0x6aae200528fe616b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6aae200528fe6172 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790736310.706512:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1790736310.706514:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1790736310.706515:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1790736310.706536:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff941600031c00/0x6aae200528fe616b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6aae200528fe6172 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736310.706541:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790736310.706547:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff941600031c00/0x6aae200528fe616b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6aae200528fe6172 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736310.706553:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff941600031c00/0x6aae200528fe616b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6aae200528fe6172 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736310.706566:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790736310.706569:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff941633c61a00/0x6aae200528fe645f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6aae200528fe6466 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736310.706575:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c61a00 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:1.0:1790736310.706577:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff941633c61a00/0x6aae200528fe645f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6aae200528fe6466 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736310.706583:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff941633c61a00/0x6aae200528fe645f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6aae200528fe6466 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790736310.706588:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff941633c61a00/0x6aae200528fe645f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6aae200528fe6466 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790736310.706603:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1790736310.706605:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1790736310.706607:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1790736310.706622:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff941633c61a00/0x6aae200528fe645f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6aae200528fe6466 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736310.706628:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790736310.706645:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff941633c61a00/0x6aae200528fe645f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6aae200528fe6466 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736310.706651:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff941633c61a00/0x6aae200528fe645f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6aae200528fe6466 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736310.706660:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790736310.706663:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff941642172400/0x6aae200528fe5f1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6aae200528fe5f26 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736310.706669:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642172400 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:1.0:1790736310.706672:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff941642172400/0x6aae200528fe5f1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6aae200528fe5f26 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736310.706678:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff941642172400/0x6aae200528fe5f1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6aae200528fe5f26 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790736310.706683:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff941642172400/0x6aae200528fe5f1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6aae200528fe5f26 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790736310.706687:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1790736310.706689:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1790736310.706690:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1790736310.706709:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff941642172400/0x6aae200528fe5f1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6aae200528fe5f26 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736310.706714:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790736310.706720:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff941642172400/0x6aae200528fe5f1f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6aae200528fe5f26 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736310.706725:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff941642172400/0x6aae200528fe5f1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6aae200528fe5f26 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736310.706736:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736310.706737:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736310.706739:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736310.706756:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941635cfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816139136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790736310.706817:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736310.706866:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790736310.706873:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941635cfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816139264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790736310.706894:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736310.706921:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52e04a2b-4e01-44b7-985c-7db034e22389:3307:1877722816139520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790736310.706940:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736310.706956:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790736310.706960:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f241f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52e04a2b-4e01-44b7-985c-7db034e22389:3307:1877722816139392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790736310.706976:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736310.707001:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816139136 00000100:00100000:1.0:1790736310.707007:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816139136 00000100:00100000:1.0:1790736310.707038:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816139264 00000100:00100000:1.0:1790736310.707041:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816139264 00000100:00100000:1.0:1790736310.707052:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816139520 00000100:00100000:1.0:1790736310.707054:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816139520 00000100:00100000:1.0:1790736310.707066:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816139392 00000100:00100000:1.0:1790736310.707090:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816139392 00000100:00100000:1.0:1790736310.707138:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790736310.707147:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642041180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52e04a2b-4e01-44b7-985c-7db034e22389+21:3308:x1877722816139136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790736310.707158:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736310.707170:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94162156e600/0x6aae200528fe624b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6aae200528fe6244 expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736310.707182:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790736310.707217:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642041180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52e04a2b-4e01-44b7-985c-7db034e22389+20:3308:x1877722816139136:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (400us total) trans 0 rc 0/0 00010000:00010000:0.0:1790736310.707342:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736310.708200:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000020:00000080:2.0:1790736310.708330:0:12994:0:(genops.c:885:class_export_put()) final put ffff94162f89c000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1790736310.708345:0:12994:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff94163fa04800), last request at 1790736310 00000020:00000080:2.0:1790736310.708353:0:12994:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6aae200528fe6068 00000100:00080000:2.0:1790736310.708362:0:12994:0:(import.c:65:import_set_state_nolock()) ffff9416181a9800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1790736310.708382:0:12994:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff94163fa04800): rc 0 00000020:00000080:2.0:1790736310.708384:0:12994:0:(genops.c:885:class_export_put()) final put ffff94163fa04800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1790736310.708391:0:12994:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb2d3c146bae0 00000100:00080000:2.0:1790736310.708412:0:12994:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790736310.708416:0:12994:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1790736310.708428:0:12994:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1790736310.708500:0:12994:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1790736310.708521:0:12994:0:(import.c:65:import_set_state_nolock()) ffff941637efa000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1790736310.708537:0:12994:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1790736310.708540:0:12994:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1790736310.708547:0:12994:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1790736310.708614:0:12994:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1790736310.708623:0:12994:0:(import.c:65:import_set_state_nolock()) ffff94162d355000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1790736310.708652:0:12994:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff94160837cd40) has no exports 00000020:00000080:3.0:1790736310.708950:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff94162f89c000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1790736310.709004:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff94163fa04800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1790736310.709033:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94162f89b800 for lustre-MDT0000 00000020:00000080:3.0:1790736310.709037:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9416181a9800 for lustre-MDT0000 00010000:00010000:3.0:1790736310.709052:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790736310.711469:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790736310.711490:0:8527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642040000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52e04a2b-4e01-44b7-985c-7db034e22389+19:3308:x1877722816139264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790736310.711514:0:8527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790736310.711534:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941600030a00/0x6aae200528fe6172 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6aae200528fe616b expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736310.711552:0:8527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790736310.711632:0:8527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642040000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52e04a2b-4e01-44b7-985c-7db034e22389+18:3308:x1877722816139264:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (4735us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736310.711640:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790736310.711672:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790736310.711695:0:8527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642041880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52e04a2b-4e01-44b7-985c-7db034e22389+17:3307:x1877722816139520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790736310.711704:0:8527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790736310.711713:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941600030000/0x6aae200528fe5f26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6aae200528fe5f1f expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736310.711721:0:8527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790736310.711760:0:8527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642041880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52e04a2b-4e01-44b7-985c-7db034e22389+16:3307:x1877722816139520:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (4819us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736310.711766:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790736310.711779:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790736310.711786:0:8527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642041f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52e04a2b-4e01-44b7-985c-7db034e22389+15:3307:x1877722816139392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790736310.711796:0:8527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790736310.711805:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941642173000/0x6aae200528fe6466 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6aae200528fe645f expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736310.711814:0:8527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790736310.711837:0:8527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642041f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52e04a2b-4e01-44b7-985c-7db034e22389+14:3307:x1877722816139392:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (4860us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736310.711842:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790736310.711998:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f241f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52e04a2b-4e01-44b7-985c-7db034e22389:3307:1877722816139392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790736310.712008:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52e04a2b-4e01-44b7-985c-7db034e22389:3307:1877722816139520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790736310.715589:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1877722816139648:0@lo:9:umount.0 00000100:00100000:0.0:1790736310.715675:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736310.715728:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1877722816139776:0@lo:9:umount.0 00000100:00100000:0.0:1790736310.715751:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736310.715822:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941635cfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816139264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790736310.715833:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941635cfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52e04a2b-4e01-44b7-985c-7db034e22389:3308:1877722816139136:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790736310.715864:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736310.715929:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816139648 00000100:00100000:1.0:1790736310.715938:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816139648 00000100:00100000:1.0:1790736310.715989:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816139776 00000100:00100000:1.0:1790736310.715993:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816139776 00000100:00100000:1.0:1790736310.716015:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790736310.716024:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1877722816139648:12345-0@lo:9:umount.0 00000020:00000080:1.0:1790736310.716053:0:6698:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6aae200528fe60b5 00000100:00080000:1.0:1790736310.716063:0:6698:0:(import.c:65:import_set_state_nolock()) ffff941501215800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790736310.716126:0:6698:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1790736310.716476:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3305:x1877722816139648:12345-0@lo:9:umount.0 Request processed in 451us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736310.716484:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790736310.716500:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790736310.716507:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1877722816139776:12345-0@lo:9:umount.0 00000020:00000080:1.0:1790736310.716525:0:6698:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6aae200528fe61aa 00000100:00080000:1.0:1790736310.716531:0:6698:0:(import.c:65:import_set_state_nolock()) ffff941603185000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790736310.716558:0:6698:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1790736310.716756:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3305:x1877722816139776:12345-0@lo:9:umount.0 Request processed in 249us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736310.716763:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:1.0:1790736310.716784:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790736310.716808:0:3305:0:(import.c:65:import_set_state_nolock()) ffff941637efa000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1790736310.716822:0:3305:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1790736310.716824:0:3305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790736310.716827:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1877722816139648:0@lo:9:umount.0 00000100:00080000:1.0:1790736310.716838:0:3305:0:(import.c:65:import_set_state_nolock()) ffff94162d355000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1790736310.716845:0:3305:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1790736310.716847:0:3305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790736310.716849:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1877722816139776:0@lo:9:umount.0 00010000:00010000:3.0:1790736310.717520:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1790736310.729227:0:12994:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff94160837cd40) has no exports 00000020:00000080:2.0:1790736310.789026:0:12994:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6aae200528fe5f7a 00000020:00000080:2.0:1790736310.789046:0:12994:0:(genops.c:885:class_export_put()) final put ffff94162f207800/lustre-QMT0000_UUID 00000020:01000000:2.0:1790736310.789070:0:12994:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1790736310.789153:0:12664:0:(genops.c:844:class_export_destroy()) destroying export ffff94162f207800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1790736310.789240:0:12994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790736310.789251:0:12994:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790736310.789256:0:12994:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff941612f44d40) has no exports 00000020:00000080:0.0:1790736310.792330:0:12994:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6aae200528fe5f73 00000020:00000080:0.0:1790736310.792345:0:12994:0:(genops.c:885:class_export_put()) final put ffff9416115d6800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1790736310.792423:0:12994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790736310.792435:0:12994:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1790736310.792438:0:12994:0:(genops.c:885:class_export_put()) final put ffff9416115d0000/lustre-QMT0000_UUID 00000020:00000080:0.0:1790736310.792441:0:12994:0:(genops.c:844:class_export_destroy()) destroying export ffff9416115d0000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1790736310.792454:0:12994:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1790736310.792641:0:12664:0:(genops.c:844:class_export_destroy()) destroying export ffff9416115d6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1790736310.793362:0:12994:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff941633c24f60 - data ffff94163fdc2af8/ffff941603fa2000 00000020:01000000:0.0:1790736310.793500:0:12994:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9416066c2420 - data ffff94162cfc2e58/ffff94163c4bd400 00000001:00000004:1.0:1790736310.809235:0:12994:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:0.0:1790736310.932725:0:12994:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1790736310.932735:0:12994:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1790736310.932758:0:12994:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790736310.932761:0:12994:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1790736310.935597:0:6795:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1790736310.935605:0:6795:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:2.0:1790736310.935617:0:6795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1790736310.945043:0:12994:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1790736310.945054:0:12994:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1790736310.945367:0:12994:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790736310.945371:0:12994:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1790736310.955452:0:7909:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1790736310.955460:0:7909:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:2.0:1790736310.955473:0:7909:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1790736310.993502:0:12994:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6aae200528fe5f42 00000020:00000080:0.0:1790736310.993514:0:12994:0:(genops.c:885:class_export_put()) final put ffff94162ed88000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1790736310.994554:0:12994:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6aae200528fe5f57 00000020:00000080:0.0:1790736310.994561:0:12994:0:(genops.c:885:class_export_put()) final put ffff941634027000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1790736310.994566:0:12994:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1790736310.994570:0:12994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790736310.994578:0:12994:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790736310.994582:0:12994:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff941608378000) has no exports 00000004:01000000:0.0:1790736310.994722:0:12994:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1790736310.994729:0:12994:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6aae200528fe6195 00000020:00000080:0.0:1790736310.994733:0:12994:0:(genops.c:885:class_export_put()) final put ffff941633dfb800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1790736310.994736:0:12994:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1790736310.994745:0:12994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790736310.994750:0:12994:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790736310.994752:0:12994:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff941637f699c0) has no exports 00000020:00000080:0.0:1790736310.994758:0:12994:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6aae200528fe618e 00000020:00000080:0.0:1790736310.994761:0:12994:0:(genops.c:885:class_export_put()) final put ffff94162d350800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1790736310.995049:0:12994:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1790736310.995053:0:12994:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1790736310.995057:0:12994:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1790736310.995061:0:12994:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790736310.995063:0:12994:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790736310.995089:0:12994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790736310.995115:0:12994:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790736310.995120:0:12994:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6aae200528fe60ae 00000020:00000080:0.0:1790736310.995124:0:12994:0:(genops.c:885:class_export_put()) final put ffff94163fa06000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1790736310.995127:0:12994:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1790736310.995130:0:12994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790736310.995133:0:12994:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790736310.995135:0:12994:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9416181e19c0) has no exports 00000020:00000080:0.0:1790736310.995138:0:12994:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6aae200528fe60a7 00000020:00000080:0.0:1790736310.995141:0:12994:0:(genops.c:885:class_export_put()) final put ffff941637ef8800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1790736310.995411:0:12994:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1790736310.995414:0:12994:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1790736310.995416:0:12994:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1790736310.995419:0:12994:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790736310.995420:0:12994:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790736310.995439:0:12994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790736310.995443:0:12994:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790736310.995463:0:12994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790736310.995465:0:12994:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790736310.995489:0:12994:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6aae200528fe5f5e 00000020:00000080:0.0:1790736310.995493:0:12994:0:(genops.c:885:class_export_put()) final put ffff941634024800/lustre-MDD0000_UUID 00000020:01000000:0.0:1790736310.995496:0:12994:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1790736310.995503:0:12994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790736310.995506:0:12994:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790736310.995508:0:12994:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff941634008000) has no exports 00000020:00000080:0.0:1790736310.995525:0:12994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790736310.995528:0:12994:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1790736310.995530:0:12994:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6aae200528fe5f65 00000020:00000080:0.0:1790736310.995533:0:12994:0:(genops.c:885:class_export_put()) final put ffff941634025000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1790736310.995538:0:12994:0:(tgt_mount.c:187:server_put_mount()) put mount ffff941604c0d800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1790736310.995541:0:12994:0:(obd_mount.c:710:lustre_put_lsi()) put ffff941604c0d800 3 00000020:01000004:0.0:1790736310.995544:0:12994:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff941604c0d800 from lustre-MDT0000 00000020:00000080:0.0:1790736310.995558:0:12994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790736310.995560:0:12994:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1790736310.995562:0:12994:0:(genops.c:885:class_export_put()) final put ffff94162ed8a800/lustre-MDT0000_UUID 00000020:00000080:0.0:1790736310.995564:0:12994:0:(genops.c:844:class_export_destroy()) destroying export ffff94162ed8a800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1790736310.995572:0:12994:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1790736310.995622:0:12994:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1790736310.995625:0:12994:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1790736310.995627:0:12994:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1790736310.995629:0:12994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790736310.995631:0:12994:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790736310.995637:0:12994:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff94161816b000 52e04a2b-4e01-44b7-985c-7db034e22389 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790736310.995642:0:12994:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff941612f40000) has exports, disconnecting them 00000020:00080000:0.0:1790736310.995645:0:12994:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff94161816b000), last request at 1790736083 00000020:00000080:0.0:1790736310.995656:0:12994:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6aae200528fe5f03 00000020:00010000:0.0:1790736310.995659:0:12994:0:(genops.c:1920:obd_stale_export_put()) Put export ffff94161816b000: total 8 00000100:00080000:0.0:1790736310.995662:0:12994:0:(import.c:65:import_set_state_nolock()) ffff94161816a800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1790736310.995676:0:12994:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff94161816b000): rc 0 00000020:00080000:0.0:1790736310.995680:0:12994:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff941612f40000) has no exports 00000020:00010000:0.0:1790736310.995691:0:5832:0:(genops.c:1906:obd_stale_export_get()) Get export ffff94161816b000: total 8 00010000:00010000:0.0:1790736310.995707:0:5832:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff94161816b000, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1790736310.995728:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941600030e00/0x6aae200528fe6205 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6aae200528fe61fe expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736310.995750:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94162f8c9600/0x6aae200528fe6221 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6aae200528fe621a expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736310.995759:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941611930200/0x6aae200528fe6213 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6aae200528fe620c expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736310.995769:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941633c61200/0x6aae200528fe644a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6aae200528fe6443 expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736310.995777:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941611930e00/0x6aae200528fe622f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6aae200528fe6228 expref: 5 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736310.995785:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941600030c00/0x6aae200528fe601b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6aae200528fe6014 expref: 4 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736310.995794:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941611931200/0x6aae200528fe6259 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6aae200528fe6252 expref: 3 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736310.995804:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94162f8c9e00/0x6aae200528fe6458 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6aae200528fe6451 expref: 2 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736310.995812:0:5832:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff94161816b000, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1790736310.995821:0:5832:0:(genops.c:885:class_export_put()) final put ffff94161816b000/52e04a2b-4e01-44b7-985c-7db034e22389 00010000:00010000:0.0:1790736310.995825:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736310.995827:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736310.995829:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790736310.995927:0:12664:0:(genops.c:844:class_export_destroy()) destroying export ffff94162ed88000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1790736310.995944:0:12664:0:(genops.c:844:class_export_destroy()) destroying export ffff941634027000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1790736310.995948:0:12664:0:(genops.c:885:class_export_put()) final put ffff94162ed8f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790736310.995949:0:12664:0:(genops.c:844:class_export_destroy()) destroying export ffff94162ed8f800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1790736310.995952:0:12664:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790736310.996039:0:12664:0:(genops.c:844:class_export_destroy()) destroying export ffff941633dfb800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1790736310.996043:0:12664:0:(genops.c:844:class_export_destroy()) destroying export ffff94162d350800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1790736310.996047:0:12664:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94162d355000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1790736310.996050:0:12664:0:(genops.c:885:class_export_put()) final put ffff94162d361000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790736310.996051:0:12664:0:(genops.c:844:class_export_destroy()) destroying export ffff94162d361000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1790736310.996055:0:12664:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790736310.996074:0:12664:0:(genops.c:844:class_export_destroy()) destroying export ffff94163fa06000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1790736310.996078:0:12664:0:(genops.c:844:class_export_destroy()) destroying export ffff941637ef8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1790736310.996081:0:12664:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff941637efa000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1790736310.996084:0:12664:0:(genops.c:885:class_export_put()) final put ffff941637efc000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790736310.996086:0:12664:0:(genops.c:844:class_export_destroy()) destroying export ffff941637efc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1790736310.996089:0:12664:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790736310.996152:0:12664:0:(genops.c:844:class_export_destroy()) destroying export ffff941634024800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1790736310.996155:0:12664:0:(genops.c:885:class_export_put()) final put ffff94162ed8c800/lustre-MDD0000_UUID 00000020:00000080:2.0:1790736310.996157:0:12664:0:(genops.c:844:class_export_destroy()) destroying export ffff94162ed8c800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1790736310.996159:0:12664:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1790736310.996284:0:12664:0:(genops.c:844:class_export_destroy()) destroying export ffff941634025000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1790736310.996288:0:12664:0:(genops.c:844:class_export_destroy()) destroying export ffff94161816b000/52e04a2b-4e01-44b7-985c-7db034e22389 for MGS 00000020:00000080:2.0:1790736310.996311:0:12664:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94161816a800 for MGS 00000100:00100000:2.0:1790736310.996334:0:5837:0:(service.c:3206:ptlrpc_main()) ll_mgs_0001: service thread [ffff9416106e9800:5837] 1 exiting: rc = 0 00000100:00100000:2.0:1790736310.996403:0:5838:0:(service.c:3206:ptlrpc_main()) ll_mgs_0002: service thread [ffff941613668a00:5838] 2 exiting: rc = 0 00000100:00100000:3.0:1790736310.996504:0:5836:0:(service.c:3206:ptlrpc_main()) ll_mgs_0000: service thread [ffff941613669800:5836] 0 exiting: rc = 1 00000100:00100000:0.0:1790736310.996806:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.996813:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.996819:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.996824:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.996838:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.996843:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.996848:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.996853:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.996858:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.996864:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.996870:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.996882:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.996888:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.996892:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.996897:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.996902:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.996906:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.996911:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.996916:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.996922:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.996933:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.996940:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.996945:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.996950:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.996955:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.996960:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.996964:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.996970:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.996975:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.996981:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.996985:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.996990:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.996994:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.996999:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.997004:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.997009:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.997013:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.997018:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.997023:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.997033:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.997038:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.997043:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.997048:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.997053:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.997057:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.997062:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.997068:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.997072:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.997310:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.997315:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.997320:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.997327:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.997332:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.997336:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.997341:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.997354:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.997359:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.997364:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.997369:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.997373:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.997378:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.997383:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.997388:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736310.997393:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1790736310.997721:0:12994:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1790736310.997724:0:12994:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1790736310.998375:0:12994:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff94163c539b40 - data ffff941625fa5288/ffff941637e93000 00000020:01000000:0.0:1790736310.998484:0:12994:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff941610fb4de0 - data ffff94162cf1c948/ffff941605725000 00000020:00000080:0.0:1790736310.998879:0:12994:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6aae200528fe5ee7 00000020:00000080:0.0:1790736310.998886:0:12994:0:(genops.c:885:class_export_put()) final put ffff9416120e7800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1790736310.998895:0:12994:0:(tgt_mount.c:187:server_put_mount()) put mount ffff941604c0d800 from MGS, refs=2 00000020:01000004:0.0:1790736310.998897:0:12994:0:(obd_mount.c:710:lustre_put_lsi()) put ffff941604c0d800 2 00000020:01000004:0.0:1790736310.998900:0:12994:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff941604c0d800 from MGS 00000020:00000080:0.0:1790736310.998926:0:12994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790736310.998932:0:12994:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1790736310.998934:0:12994:0:(genops.c:885:class_export_put()) final put ffff9416120e6000/MGS 00000020:00000080:0.0:1790736310.998937:0:12994:0:(genops.c:844:class_export_destroy()) destroying export ffff9416120e6000/MGS for MGS 00000020:01000000:0.0:1790736310.998942:0:12994:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1790736310.998984:0:12994:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1790736310.998987:0:12994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790736310.998992:0:12994:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790736310.998997:0:12994:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff94162e534800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790736310.999003:0:12994:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff9416181e3380) has exports, disconnecting them 00000020:00080000:0.0:1790736310.999006:0:12994:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff94162e534800), last request at 1790736085 00000020:00000080:0.0:1790736310.999011:0:12994:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6aae200528fe5fb2 00000020:00080000:0.0:1790736310.999018:0:12994:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff94162e534800): rc 0 00000020:00000080:0.0:1790736310.999021:0:12994:0:(genops.c:885:class_export_put()) final put ffff94162e534800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1790736310.999174:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9416120e7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1790736310.999182:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff94162e534800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1790736311.002554:0:12994:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1790736311.002563:0:12994:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790736311.002567:0:12994:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790736311.002572:0:12994:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790736311.002720:0:12994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790736311.002727:0:12994:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1790736311.002733:0:12994:0:(obd_mount.c:710:lustre_put_lsi()) put ffff941604c0d800 1 00000020:00000080:0.0:1790736311.002738:0:12994:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6aae200528fe5ed9 00000020:00000080:0.0:1790736311.002745:0:12994:0:(genops.c:885:class_export_put()) final put ffff9416120e3800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1790736311.002750:0:12994:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1790736311.002754:0:12994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790736311.002757:0:12994:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790736311.002760:0:12994:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9416181e4d40) has no exports 00000020:00000080:2.0:1790736311.002860:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94162a68b000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1790736311.002866:0:479:0:(genops.c:885:class_export_put()) final put ffff94162e537000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1790736311.002869:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff94162e537000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1790736311.002874:0:479:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1790736311.002924:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9416120e3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1790736311.032035:0:12994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790736311.032049:0:12994:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1790736311.032054:0:12994:0:(genops.c:885:class_export_put()) final put ffff941604c08000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790736311.032058:0:12994:0:(genops.c:844:class_export_destroy()) destroying export ffff941604c08000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1790736311.032065:0:12994:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1790736311.032291:0:12994:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff941604c0c800 00000020:01000000:1.0:1790736311.032311:0:12994:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1790736311.032314:0:12994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790736311.032318:0:12994:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790736311.032321:0:12994:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9416083799c0) has no exports 00000100:00100000:0.0:1790736311.032966:0:5845:0:(service.c:3206:ptlrpc_main()) mdt00_002: service thread [ffff94160310cc00:5845] 2 exiting: rc = 0 00000100:00100000:3.0:1790736311.034162:0:5843:0:(service.c:3206:ptlrpc_main()) mdt00_000: service thread [ffff941609b7ba00:5843] 0 exiting: rc = 1 00000100:00100000:3.0:1790736311.034275:0:5844:0:(service.c:3206:ptlrpc_main()) mdt00_001: service thread [ffff94160310c000:5844] 1 exiting: rc = 0 00000100:00100000:1.0:1790736311.034437:0:8114:0:(service.c:3206:ptlrpc_main()) mdt00_003: service thread [ffff941605bf9800:8114] 3 exiting: rc = 0 00000100:00100000:1.0:1790736311.034549:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.034575:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.034586:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.034597:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.034607:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.034617:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.034628:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.034639:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.034662:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035423:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035436:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035456:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035467:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035477:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035487:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035498:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035507:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035518:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035527:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035536:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035547:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035556:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035567:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035576:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035587:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035602:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035613:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035623:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035635:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035657:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035677:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035690:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035700:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035710:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035721:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035731:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035755:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035765:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035775:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035785:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035795:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035805:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035814:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035824:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035834:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035844:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035855:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035864:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035876:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035885:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035896:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035906:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035916:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035925:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035934:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035945:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035954:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035964:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035975:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035984:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.035994:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.036010:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.036019:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.036028:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.042203:0:5846:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff94160310d400:5846] 0 exiting: rc = 1 00000100:00100000:3.0:1790736311.042433:0:5847:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff941611cb1800:5847] 1 exiting: rc = 0 00000100:00100000:1.0:1790736311.042664:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042674:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042680:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042686:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042692:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042698:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042703:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042720:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042725:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042731:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042736:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042742:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042749:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042754:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042760:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042765:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042770:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042775:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042780:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042785:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042790:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042794:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042799:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042804:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042810:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042815:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042821:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042827:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042831:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042836:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042842:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042846:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042851:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042857:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042863:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042868:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042874:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042879:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042884:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042889:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042894:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042899:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042914:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042920:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042925:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042930:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042935:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042939:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042944:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042949:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042955:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042960:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042965:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042971:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042976:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042981:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042986:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042990:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.042996:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.043002:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.043007:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.043012:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.043018:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.043023:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.043652:0:5848:0:(service.c:3206:ptlrpc_main()) mdt_out00_000: service thread [ffff941602e83200:5848] 0 exiting: rc = 1 00000100:00100000:2.0:1790736311.043791:0:5849:0:(service.c:3206:ptlrpc_main()) mdt_out00_001: service thread [ffff941602e83400:5849] 1 exiting: rc = 0 00000100:00100000:1.0:1790736311.045369:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045379:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045385:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045391:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045397:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045402:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045407:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045413:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045418:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045432:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045439:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045445:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045451:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045471:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045477:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045483:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045490:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045496:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045502:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045508:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045514:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045532:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045539:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045544:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045550:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045555:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045561:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045566:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045571:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045577:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045582:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045587:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045594:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045611:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045617:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045623:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045629:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045634:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045639:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045645:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045651:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045657:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045663:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045669:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045674:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045692:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045698:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045704:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045717:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045723:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045729:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045734:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045740:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045745:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045751:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045757:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045762:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045781:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045788:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045793:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045801:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045810:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045817:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.045824:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736311.054396:0:5850:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0000: service thread [ffff941611cb0800:5850] 0 exiting: rc = 1 00000100:00100000:3.0:1790736311.054564:0:5851:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0001: service thread [ffff941611cb1000:5851] 1 exiting: rc = 0 00000100:00100000:0.0:1790736311.054724:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054745:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054750:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054755:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054761:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054766:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054772:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054777:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054782:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054787:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054791:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054796:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054800:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054806:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054811:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054816:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054821:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054826:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054832:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054837:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054842:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054847:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054853:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054859:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054864:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054869:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054874:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054879:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054884:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054889:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054894:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054899:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054904:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054909:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054914:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054919:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054931:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054936:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054941:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054946:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054951:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054957:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054962:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054967:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054972:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054977:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054982:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054987:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054992:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.054998:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.055003:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.055009:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.055014:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.055019:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.055025:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.055030:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.055035:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.055041:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.055046:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.055050:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.055055:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.055060:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.055065:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.055070:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.055550:0:5852:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0000: service thread [ffff941611cb0c00:5852] 0 exiting: rc = 1 00000100:00100000:1.0:1790736311.055811:0:5853:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0001: service thread [ffff941611cb0a00:5853] 1 exiting: rc = 0 00000100:00100000:0.0:1790736311.055912:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.055918:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.055924:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.055928:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.055933:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.055938:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.055952:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.055957:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.055963:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.055968:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.055973:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.055977:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.055982:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.055987:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.055992:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.055997:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056003:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056008:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056013:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056018:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056023:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056028:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056033:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056038:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056043:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056048:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056053:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056058:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056063:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056067:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056073:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056077:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056082:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056087:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056280:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056288:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056293:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056298:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056303:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056309:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056314:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056327:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056332:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056337:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056342:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056347:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056352:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056358:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056364:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056369:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056374:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056379:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056384:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056389:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056394:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056398:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056403:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056407:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056412:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056417:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056422:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056426:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056431:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.056436:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736311.057127:0:5855:0:(service.c:3206:ptlrpc_main()) mdt_fld_0001: service thread [ffff941611cb0e00:5855] 1 exiting: rc = 0 00000100:00100000:1.0:1790736311.057376:0:5854:0:(service.c:3206:ptlrpc_main()) mdt_fld_0000: service thread [ffff941611cb1600:5854] 0 exiting: rc = 1 00000100:00100000:0.0:1790736311.057494:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057501:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057506:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057512:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057517:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057523:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057528:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057533:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057538:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057544:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057550:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057555:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057571:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057578:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057583:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057588:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057593:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057598:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057603:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057608:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057614:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057619:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057624:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057629:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057634:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057640:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057646:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057651:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057656:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057661:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057666:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057671:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057676:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057681:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057686:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057690:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057696:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057700:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057705:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057710:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057715:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057720:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057725:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057730:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057735:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057740:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057745:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057757:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057762:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057767:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057772:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057777:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057782:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057787:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057792:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057797:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057802:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057807:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057812:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057817:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057822:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057827:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.057832:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.058073:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790736311.060033:0:5856:0:(service.c:3206:ptlrpc_main()) mdt_io00_000: service thread [ffff9416083e1000:5856] 0 exiting: rc = 1 00000100:00100000:2.0:1790736311.060386:0:5857:0:(service.c:3206:ptlrpc_main()) mdt_io00_001: service thread [ffff9416083e0000:5857] 1 exiting: rc = 0 00000100:00100000:3.0:1790736311.060623:0:5858:0:(service.c:3206:ptlrpc_main()) mdt_io00_002: service thread [ffff941611c0f800:5858] 2 exiting: rc = 0 00000100:00100000:1.0:1790736311.060795:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.060803:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.060808:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.060814:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.060820:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.060825:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.060833:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.060839:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.060848:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.060853:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.060860:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.060865:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.060872:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.060878:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.060885:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.060891:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.060898:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.060914:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.060919:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.060926:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.060932:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.060937:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.060943:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.060948:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.060954:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.060959:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.060965:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.060971:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.060977:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.060983:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.061004:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.061011:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.061016:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.061022:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.061028:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.061033:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.061039:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.061045:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.061050:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.061055:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.061061:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.061067:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.061253:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.061263:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.061268:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.061274:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.061280:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.061287:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.061292:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.061298:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.061304:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.061310:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.061323:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.061330:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.061350:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.061358:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.061364:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.061369:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.061375:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.061381:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.061386:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.061392:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.061397:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790736311.061404:0:12994:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1790736311.063366:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790736311.065505:0:12994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790736311.065517:0:12994:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1790736311.065522:0:12994:0:(genops.c:885:class_export_put()) final put ffff94162a688000/MDS_uuid 00000020:00000080:1.0:1790736311.065527:0:12994:0:(genops.c:844:class_export_destroy()) destroying export ffff94162a688000/MDS_uuid for MDS 00000020:01000000:1.0:1790736311.065533:0:12994:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1790736311.065643:0:12994:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00000001:00100000:0.0:1790736311.535684:0:7658:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790736311.535696:0:7658:0:(genops.c:885:class_export_put()) final put ffff941603180000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790736311.538385:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff941603180000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1790736311.538482:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff941603185000 for lustre-OST0001 00010000:00010000:3.0:1790736312.085586:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736313.109734:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1790736314.061482:0:13146:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1790736314.082410:0:13146:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1790736314.082459:0:13146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff941600031800/0x6aae200528fe621a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6221 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736314.082475:0:13146:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff941600031800/0x6aae200528fe621a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe6221 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736314.082482:0:13146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff941600031800/0x6aae200528fe621a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x6aae200528fe6221 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736314.082490:0:13146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.105@tcp lock: ffff941600031800/0x6aae200528fe621a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x6aae200528fe6221 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736314.082527:0:13146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790736314.082532:0:13146:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1790736314.082560:0:13146:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790736314.082565:0:13146:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1790736314.082571:0:13146:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790736314.082596:0:13146:0:(import.c:65:import_set_state_nolock()) ffff94163fa00000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1790736314.082798:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941642040700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1877722816139904:0@lo:39:umount.0 00000400:00000100:3.0:1790736314.082862:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877722816139904 offset 0 length 224: 4 00010000:00010000:2.0:1790736314.083048:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790736314.083056:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff941600031800/0x6aae200528fe621a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x6aae200528fe6221 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736314.083064:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941600031800 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:2.0:1790736314.083068:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff941600031800/0x6aae200528fe621a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x6aae200528fe6221 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736314.083077:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff941600031800/0x6aae200528fe621a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x6aae200528fe6221 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790736314.083085:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff941600031800/0x6aae200528fe621a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x6aae200528fe6221 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790736314.083105:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790736314.083108:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1790736314.083110:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1790736314.083138:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff941600031800/0x6aae200528fe621a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x6aae200528fe6221 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736314.083145:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790736314.083175:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff941600031800/0x6aae200528fe621a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x6aae200528fe6221 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736314.083182:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff941600031800/0x6aae200528fe621a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x6aae200528fe6221 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736314.083203:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736314.083206:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736314.083208:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790736314.083216:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790736314.083226:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52e04a2b-4e01-44b7-985c-7db034e22389:3309:1877722816140032:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790736314.083263:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736314.083305:0:8527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816140032 00000100:00100000:2.0:1790736314.083311:0:8527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816140032 00000100:00100000:2.0:1790736314.083352:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790736314.083361:0:8527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f264a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3309:x1877722816140032:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790736314.083367:0:8527:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790736314 with bad export cookie 7687116820502699779 00000100:00100000:1.0:1790736314.107310:0:8527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f264a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3309:x1877722816140032:12345-0@lo:103:ldlm_bl.0 Request processed in 23940us (24037us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790736314.107325:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1790736314.107337:0:3309:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.105@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1790736314.107343:0:3309:0:(import.c:65:import_set_state_nolock()) ffff94162a68c800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1790736314.107348:0:3309:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1790736314.115841:0:3309:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.105@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1790736314.115848:0:3309:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1790736314.115858:0:3309:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94162f264000 x1877722816140032/t0(0) o103->MGC192.168.203.105@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790736330 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1790736314.115873:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1790736314.115875:0:3309:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1790736314.115877:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1790736314.115881:0:3309:0:(import.c:65:import_set_state_nolock()) ffff94162a68c800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790736314.115905:0:3309:0:(import.c:545:import_select_connection()) MGC192.168.203.105@tcp: connect to NID 0@lo last attempt 155 00000100:00080000:0.0:1790736314.115917:0:3309:0:(import.c:666:import_select_connection()) MGC192.168.203.105@tcp: import ffff94162a68c800 using connection 192.168.203.105@tcp/0@lo 00000100:00100000:1.0:1790736314.116348:0:3309:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff941642041500 x1877722816140160/t0(0) o250->MGC192.168.203.105@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790736314.116392:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52e04a2b-4e01-44b7-985c-7db034e22389:3309:1877722816140032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790736314.116467:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941642041500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:52e04a2b-4e01-44b7-985c-7db034e22389:3305:1877722816140160:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:3.0:1790736314.116513:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877722816140160 offset 0 length 520: 4 00010000:00010000:3.0:1790736314.133235:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790736315.108122:0:6725:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790736315.108132:0:6725:0:(genops.c:885:class_export_put()) final put ffff941501217800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790736315.108283:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff941501217800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1790736315.108330:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff941501215800 for lustre-OST0000 00010000:00010000:0.0:1790736315.157390:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790736315.543969:0:12664:0:(pinger.c:229:ptlrpc_pinger_process_import()) 52e04a2b-4e01-44b7-985c-7db034e22389->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790736315.543979:0:12664:0:(pinger.c:247:ptlrpc_pinger_process_import()) 52e04a2b-4e01-44b7-985c-7db034e22389->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790736315.544123:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790736315.544143:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1877722816140288:0@lo:400:kworker.0 00000400:00000100:3.0:1790736315.544210:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877722816140288 offset 0 length 224: 4 00010000:00010000:2.0:1790736316.182832:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736317.205241:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736318.230407:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736319.253365:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790736319.573355:0:12664:0:(pinger.c:229:ptlrpc_pinger_process_import()) 52e04a2b-4e01-44b7-985c-7db034e22389->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790736319.573366:0:12664:0:(pinger.c:247:ptlrpc_pinger_process_import()) 52e04a2b-4e01-44b7-985c-7db034e22389->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790736319.573617:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790736319.573638:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1877722816140416:0@lo:400:kworker.0 00000400:00000100:1.0:1790736319.573693:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877722816140416 offset 0 length 224: 4 00010000:00010000:3.0:1790736320.277239:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736321.301874:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736322.325381:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736323.351271:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736324.245273:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790736314/real 1790736314] req@ffff941642041500 x1877722816140160/t0(0) o250->MGC192.168.203.105@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790736324 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736324.245346:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff941642041500 x1877722816140160/t0(0) o250->MGC192.168.203.105@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790736324 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736324.245358:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790736314/real 1790736314] req@ffff941642040700 x1877722816139904/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790736324 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736324.245372:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff941642040700 x1877722816139904/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790736324 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790736324.245393:0:3305:0:(import.c:65:import_set_state_nolock()) ffff94162a68c800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790736324.245424:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1790736324.245428:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941642041500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:52e04a2b-4e01-44b7-985c-7db034e22389:3305:1877722816140160:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:3.0:1790736324.245436:0:3305:0:(import.c:65:import_set_state_nolock()) ffff94163fa00000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1790736324.245456:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941642040700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1877722816139904:0@lo:39:umount.0 00000100:00080000:2.0:1790736324.245561:0:13146:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790736324.245567:0:13146:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790736324.245573:0:13146:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1790736324.246592:0:13146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162156e200/0x6aae200528fe6228 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe622f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736324.246610:0:13146:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162156e200/0x6aae200528fe6228 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe622f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736324.246636:0:13146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162156e200/0x6aae200528fe6228 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x6aae200528fe622f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736324.246644:0:13146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.105@tcp lock: ffff94162156e200/0x6aae200528fe6228 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x6aae200528fe622f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736324.246674:0:13146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790736324.246684:0:13146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff941633c61600/0x6aae200528fe6451 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6458 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736324.246692:0:13146:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff941633c61600/0x6aae200528fe6451 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe6458 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736324.246699:0:13146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff941633c61600/0x6aae200528fe6451 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6aae200528fe6458 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736324.246707:0:13146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.105@tcp lock: ffff941633c61600/0x6aae200528fe6451 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6aae200528fe6458 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1790736324.246787:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) 52e04a2b-4e01-44b7-985c-7db034e22389->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790736324.246794:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1790736324.246798:0:479:0:(import.c:65:import_set_state_nolock()) ffff94162a68c800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790736324.246806:0:479:0:(import.c:545:import_select_connection()) MGC192.168.203.105@tcp: connect to NID 0@lo last attempt 386 00000100:00080000:1.0:1790736324.246812:0:479:0:(import.c:630:import_select_connection()) MGC192.168.203.105@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1790736324.246826:0:479:0:(import.c:666:import_select_connection()) MGC192.168.203.105@tcp: import ffff94162a68c800 using connection 192.168.203.105@tcp/0@lo 00000100:00100000:1.0:1790736324.246864:0:479:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff941642043480 x1877722816140544/t0(0) o250->MGC192.168.203.105@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790736324.246955:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941642043b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1877722816140672:0@lo:400:kworker.0 00000400:00000100:1.0:1790736324.247028:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877722816140672 offset 0 length 224: 4 00010000:00010000:2.0:1790736324.247606:0:13146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1790736324.247616:0:13146:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1790736324.247645:0:13146:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1790736324.247650:0:13146:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1790736324.247658:0:13146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790736324.247665:0:13146:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790736324.247670:0:13146:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff941637f6b380) has no exports 00000020:00080000:2.0:1790736324.247701:0:13146:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff941637f6b380) has no exports 00010000:00010000:0.0:1790736324.250187:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790736324.250208:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff94162156e200/0x6aae200528fe6228 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6aae200528fe622f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736324.250222:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162156e200 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:0.0:1790736324.250228:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff94162156e200/0x6aae200528fe6228 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6aae200528fe622f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736324.250241:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff94162156e200/0x6aae200528fe6228 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x6aae200528fe622f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790736324.250249:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff94162156e200/0x6aae200528fe6228 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x6aae200528fe622f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790736324.250255:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790736324.250258:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1790736324.250264:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1790736324.250291:0:5832:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff94162a68c800 00010000:00010000:0.0:1790736324.250295:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff94162156e200/0x6aae200528fe6228 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x6aae200528fe622f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736324.250325:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff94162156e200/0x6aae200528fe6228 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x6aae200528fe622f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736324.250345:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790736324.250350:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff941633c61600/0x6aae200528fe6451 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6aae200528fe6458 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736324.250356:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c61600 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:0.0:1790736324.250359:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff941633c61600/0x6aae200528fe6451 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6aae200528fe6458 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736324.250367:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff941633c61600/0x6aae200528fe6451 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6aae200528fe6458 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790736324.250374:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff941633c61600/0x6aae200528fe6451 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6aae200528fe6458 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790736324.250379:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1790736324.250382:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1790736324.250384:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1790736324.250391:0:5832:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff94162a68c800 00010000:00010000:0.0:1790736324.250394:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff941633c61600/0x6aae200528fe6451 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6aae200528fe6458 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736324.250401:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff941633c61600/0x6aae200528fe6451 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6aae200528fe6458 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736324.250410:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736324.250411:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736324.250420:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790736324.250495:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941642043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:52e04a2b-4e01-44b7-985c-7db034e22389:3305:1877722816140544:0@lo:250:kworker.0 00000020:01000000:2.0:1790736324.250745:0:13146:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff94163c5399c0 - data ffff94162cd526c0/ffff941637e92800 00000020:01000000:2.0:1790736324.250932:0:13146:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff941502c751e0 - data ffff9416138e8948/ffff941501231000 00000400:00000100:0.0:1790736324.251145:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877722816140544 offset 0 length 520: 4 00010000:00010000:3.0:1790736324.254649:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1790736324.262156:0:13146:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1790736324.302924:0:13146:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6aae200528fe6037 00000020:00000080:2.0:1790736324.302937:0:13146:0:(genops.c:885:class_export_put()) final put ffff941637f62800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1790736324.302958:0:13146:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94162d353800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1790736324.302962:0:13146:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94162d353800 2 00000020:01000004:2.0:1790736324.302966:0:13146:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff94162d353800 from lustre-OST0000 00000020:00000080:2.0:1790736324.303010:0:13146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790736324.303022:0:13146:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1790736324.303025:0:13146:0:(genops.c:885:class_export_put()) final put ffff941637f66000/lustre-OST0000_UUID 00000020:00000080:2.0:1790736324.303029:0:13146:0:(genops.c:844:class_export_destroy()) destroying export ffff941637f66000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1790736324.303037:0:13146:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1790736324.303084:0:13146:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1790736324.303090:0:13146:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1790736324.303130:0:13146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790736324.303136:0:13146:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790736324.303145:0:13146:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff94163fa05000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790736324.303152:0:13146:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff94163400cd40) has exports, disconnecting them 00000020:00080000:2.0:1790736324.303158:0:13146:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff94163fa05000), last request at 1790736102 00000020:00000080:2.0:1790736324.303163:0:13146:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6aae200528fe6061 00000020:00080000:2.0:1790736324.303173:0:13146:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff94163fa05000): rc 0 00000020:00000080:2.0:1790736324.303178:0:13146:0:(genops.c:885:class_export_put()) final put ffff94163fa05000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1790736324.304315:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff941637f62800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1790736324.304341:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff94163fa05000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1790736324.308348:0:13146:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1790736324.308361:0:13146:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790736324.308368:0:13146:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1790736324.308379:0:13146:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790736324.308585:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94163fa00000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1790736324.308631:0:13146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790736324.308643:0:13146:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1790736324.308650:0:13146:0:(genops.c:885:class_export_put()) final put ffff94163fa05800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1790736324.308655:0:13146:0:(genops.c:844:class_export_destroy()) destroying export ffff94163fa05800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1790736324.308670:0:13146:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1790736324.308748:0:13146:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94162d353800 1 00000020:00000080:3.0:1790736324.308756:0:13146:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6aae200528fe5ff1 00000020:00000080:3.0:1790736324.308765:0:13146:0:(genops.c:885:class_export_put()) final put ffff94162d351000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1790736324.308793:0:13146:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1790736324.308799:0:13146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790736324.308805:0:13146:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790736324.308809:0:13146:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff941612f43380) has no exports 00000020:00000080:1.0:1790736324.309184:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff94162d351000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1790736324.348705:0:13146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790736324.348730:0:13146:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1790736324.348739:0:13146:0:(genops.c:885:class_export_put()) final put ffff94162d356800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1790736324.348746:0:13146:0:(genops.c:844:class_export_destroy()) destroying export ffff94162d356800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1790736324.348759:0:13146:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1790736324.349016:0:13146:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff94162d357800 00000020:02000400:3.0:1790736324.349114:0:13146:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1790736324.385037:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736325.397336:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736326.421207:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736327.445258:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1790736327.661683:0:13298:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1790736327.681409:0:13298:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1790736327.681498:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c8600/0x6aae200528fe61fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6205 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736327.681515:0:13298:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c8600/0x6aae200528fe61fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe6205 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736327.681522:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c8600/0x6aae200528fe61fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6aae200528fe6205 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736327.681530:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.105@tcp lock: ffff94162f8c8600/0x6aae200528fe61fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6aae200528fe6205 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736327.681549:0:13298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790736327.681554:0:13298:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1790736327.681579:0:13298:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790736327.681590:0:13298:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94163fae1c00 x1877722816140288/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790736331 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736327.681615:0:13298:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94163fae0e00 x1877722816140416/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790736335 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736327.681645:0:13298:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff941642043b80 x1877722816140672/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790736340 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736327.681654:0:13298:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:1.0:1790736327.681684:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941642043b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1877722816140672:0@lo:400:kworker.0 00000100:00100000:1.0:1790736327.681692:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1877722816140416:0@lo:400:kworker.0 00000100:00080000:1.0:1790736327.681719:0:13298:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790736327.681743:0:13298:0:(import.c:65:import_set_state_nolock()) ffff941633c50800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1790736327.681883:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790736327.681890:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff94162f8c8600/0x6aae200528fe61fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6aae200528fe6205 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736327.681898:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c8600 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:2.0:1790736327.681901:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff94162f8c8600/0x6aae200528fe61fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6aae200528fe6205 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736327.681908:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff94162f8c8600/0x6aae200528fe61fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6aae200528fe6205 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790736327.681921:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff94162f8c8600/0x6aae200528fe61fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6aae200528fe6205 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790736327.681926:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790736327.681928:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1790736327.681930:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1790736327.681940:0:5832:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff94162a68c800 00010000:00010000:2.0:1790736327.681943:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff94162f8c8600/0x6aae200528fe61fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6aae200528fe6205 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736327.681948:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff94162f8c8600/0x6aae200528fe61fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6aae200528fe6205 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736327.681958:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736327.681960:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736327.681962:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790736327.682361:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1877722816140288:0@lo:400:kworker.0 00000100:00100000:0.0:1790736327.683397:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941642043b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1877722816140800:0@lo:39:umount.0 00000400:00000100:0.0:1790736327.683451:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877722816140800 offset 0 length 224: 4 00010000:00010000:3.0:1790736328.469261:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790736329.365658:0:12664:0:(pinger.c:229:ptlrpc_pinger_process_import()) 52e04a2b-4e01-44b7-985c-7db034e22389->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790736329.365669:0:12664:0:(pinger.c:247:ptlrpc_pinger_process_import()) 52e04a2b-4e01-44b7-985c-7db034e22389->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1790736329.493263:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736330.517381:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736331.541327:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736332.565249:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736333.589423:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790736334.488815:0:12664:0:(pinger.c:229:ptlrpc_pinger_process_import()) 52e04a2b-4e01-44b7-985c-7db034e22389->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790736334.488825:0:12664:0:(pinger.c:247:ptlrpc_pinger_process_import()) 52e04a2b-4e01-44b7-985c-7db034e22389->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1790736334.613733:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736335.637250:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736336.661477:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736337.685256:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790736337.879160:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790736327/real 1790736327] req@ffff941642043b80 x1877722816140800/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790736337 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790736337.879192:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff941642043b80 x1877722816140800/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790736337 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790736337.879209:0:3305:0:(import.c:65:import_set_state_nolock()) ffff941633c50800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1790736337.879232:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941642043b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1877722816140800:0@lo:39:umount.0 00000100:00080000:1.0:1790736337.879490:0:13298:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790736337.879494:0:13298:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1790736337.879499:0:13298:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1790736337.880422:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe620c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe6213 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736337.880437:0:13298:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe620c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe6213 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736337.880444:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe620c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6aae200528fe6213 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736337.880451:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe620c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6aae200528fe6213 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736337.880480:0:13298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790736337.880489:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff941611930600/0x6aae200528fe6443 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe644a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736337.880510:0:13298:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff941611930600/0x6aae200528fe6443 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe644a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736337.880516:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff941611930600/0x6aae200528fe6443 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6aae200528fe644a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736337.880521:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.105@tcp lock: ffff941611930600/0x6aae200528fe6443 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6aae200528fe644a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736337.880544:0:13298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1790736337.880549:0:13298:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:3.0:1790736337.880554:0:11186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790736337.880563:0:11186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe620c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6aae200528fe6213 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790736337.880570:0:13298:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00010000:00010000:3.0:1790736337.880572:0:11186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941600030200 already unused, calling callback (ffffffffc1c0ec20) 00000020:01000000:1.0:1790736337.880576:0:13298:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 10000000:00010000:3.0:1790736337.880578:0:11186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe620c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6aae200528fe6213 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1790736337.880582:0:13298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790736337.880591:0:13298:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00010000:00010000:3.0:1790736337.880592:0:11186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe620c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6aae200528fe6213 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1790736337.880598:0:13298:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9416181e0000) has no exports 00010000:00010000:2.0:1790736337.880607:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790736337.880613:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff941611930600/0x6aae200528fe6443 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6aae200528fe644a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790736337.880615:0:11186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe620c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6aae200528fe6213 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736337.880620:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941611930600 already unused, calling callback (ffffffffc1c0ec20) 10000000:01000000:3.0:1790736337.880622:0:11186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:2.0:1790736337.880624:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff941611930600/0x6aae200528fe6443 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6aae200528fe644a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1790736337.880624:0:13298:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9416181e0000) has no exports 10000000:01000000:3.0:1790736337.880625:0:11186:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1790736337.880628:0:11186:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1790736337.880634:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff941611930600/0x6aae200528fe6443 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6aae200528fe644a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736337.880641:0:11186:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff94162a68c800 00010000:00010000:3.0:1790736337.880644:0:11186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe620c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6aae200528fe6213 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790736337.880646:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff941611930600/0x6aae200528fe6443 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6aae200528fe644a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790736337.880652:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790736337.880653:0:11186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff941600030200/0x6aae200528fe620c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6aae200528fe6213 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790736337.880654:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1790736337.880656:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1790736337.880661:0:5832:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff94162a68c800 00010000:00010000:2.0:1790736337.880664:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff941611930600/0x6aae200528fe6443 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x6aae200528fe644a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736337.880665:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736337.880666:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736337.880668:0:11186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736337.880690:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff941611930600/0x6aae200528fe6443 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x6aae200528fe644a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736337.880704:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736337.880706:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736337.880708:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1790736337.882288:0:13298:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff94163c539e40 - data ffff941625e70288/ffff94163fab1000 00000020:01000000:1.0:1790736337.882446:0:13298:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff94163c6118a0 - data ffff94163fc63d80/ffff941502797000 00100000:10000000:1.0:1790736337.907072:0:13298:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1790736337.931542:0:13298:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6aae200528fe6102 00000020:00000080:3.0:1790736337.931551:0:13298:0:(genops.c:885:class_export_put()) final put ffff94162f898800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1790736337.931574:0:13298:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94162d364800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1790736337.931577:0:13298:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94162d364800 2 00000020:01000004:3.0:1790736337.931580:0:13298:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff94162d364800 from lustre-OST0001 00000020:00000080:3.0:1790736337.931605:0:13298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790736337.931614:0:13298:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1790736337.931617:0:13298:0:(genops.c:885:class_export_put()) final put ffff941501213800/lustre-OST0001_UUID 00000020:00000080:3.0:1790736337.931620:0:13298:0:(genops.c:844:class_export_destroy()) destroying export ffff941501213800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1790736337.931630:0:13298:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1790736337.931715:0:13298:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 52e04a2b-4e01-44b7-985c-7db034e22389->MGS 00010000:00010000:3.0:1790736337.931731:0:13298:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff94162156ee00/0x6aae200528fe6014 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6aae200528fe601b expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790736337.931762:0:13298:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff94162156ee00/0x6aae200528fe6014 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6aae200528fe601b expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790736337.931768:0:13298:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1790736337.931771:0:13298:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1790736337.931774:0:13298:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1790736337.931788:0:13298:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff94162a68c800 00010000:00010000:3.0:1790736337.931792:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff94162156ee00/0x6aae200528fe6014 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6aae200528fe601b expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736337.931808:0:13298:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff94162156fc00/0x6aae200528fe6252 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6aae200528fe6259 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790736337.931814:0:13298:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff94162156fc00/0x6aae200528fe6252 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6aae200528fe6259 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790736337.931819:0:13298:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790736337.931821:0:13298:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1790736337.931823:0:13298:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1790736337.931831:0:13298:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff94162a68c800 00010000:00010000:3.0:1790736337.931834:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff94162156fc00/0x6aae200528fe6252 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6aae200528fe6259 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1790736337.931849:0:13298:0:(import.c:65:import_set_state_nolock()) ffff94162a68c800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1790736337.931853:0:13298:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1790736337.931855:0:13298:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1790736337.931857:0:13298:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1790736337.931861:0:13298:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1790736337.931872:0:13298:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff941642043480 x1877722816140544/t0(0) o250->MGC192.168.203.105@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1790736339 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1790736337.931902:0:13298:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1790736337.931905:0:13298:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000020:00000080:0.0:1790736337.931951:0:12664:0:(genops.c:844:class_export_destroy()) destroying export ffff94162f898800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:2.0:1790736337.932279:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941642043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:52e04a2b-4e01-44b7-985c-7db034e22389:3305:1877722816140544:0@lo:250:kworker.0 10000000:01000000:3.0:1790736337.932559:0:13298:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1790736337.932569:0:13298:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6aae200528fe5ef5 00000020:00000080:3.0:1790736337.932575:0:13298:0:(genops.c:885:class_export_put()) final put ffff94162a68d000/52e04a2b-4e01-44b7-985c-7db034e22389 00000020:01000000:3.0:1790736337.932595:0:13298:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.105@tcp (flags='') 00000020:00000080:3.0:1790736337.932602:0:13298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790736337.932607:0:13298:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.105@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1790736337.932611:0:13298:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff94160837b380) has no exports 00000020:00000080:0.0:1790736337.932660:0:12664:0:(genops.c:844:class_export_destroy()) destroying export ffff94162a68d000/52e04a2b-4e01-44b7-985c-7db034e22389 for MGC192.168.203.105@tcp 10000000:01000000:2.0:1790736337.933258:0:5841:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1790736337.935233:0:13298:0:(obd_class.h:668:obd_cleanup_client_import()) MGC192.168.203.105@tcp: client import never connected 00000100:00080000:0.0:1790736337.935240:0:13298:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1790736337.935244:0:13298:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1790736337.935249:0:13298:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1790736337.935252:0:13298:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1790736337.935329:0:13298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790736337.935338:0:13298:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.105@tcp (uuid 52e04a2b-4e01-44b7-985c-7db034e22389) 00000020:01000000:0.0:1790736337.935346:0:13298:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1790736337.935354:0:13298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790736337.935359:0:13298:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790736337.935380:0:13298:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff94162f899000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790736337.935386:0:13298:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff94163b29b380) has exports, disconnecting them 00000020:00080000:0.0:1790736337.935390:0:13298:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff94162f899000), last request at 1790736124 00000020:00000080:0.0:1790736337.935394:0:13298:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6aae200528fe612c 00000020:00080000:0.0:1790736337.935410:0:13298:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff94162f899000): rc 0 00000020:00000080:0.0:1790736337.935415:0:13298:0:(genops.c:885:class_export_put()) final put ffff94162f899000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1790736337.935736:0:12664:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94162a68c800 for MGC192.168.203.105@tcp 00000020:00000080:2.0:1790736337.935745:0:12664:0:(genops.c:885:class_export_put()) final put ffff94162a68a800/52e04a2b-4e01-44b7-985c-7db034e22389 00000020:00000080:2.0:1790736337.935748:0:12664:0:(genops.c:844:class_export_destroy()) destroying export ffff94162a68a800/52e04a2b-4e01-44b7-985c-7db034e22389 for MGC192.168.203.105@tcp 00000020:01000000:2.0:1790736337.935762:0:12664:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.105@tcp (52e04a2b-4e01-44b7-985c-7db034e22389) 00000020:00000080:2.0:1790736337.936066:0:12664:0:(genops.c:844:class_export_destroy()) destroying export ffff94162f899000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1790736337.937225:0:13298:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1790736337.937231:0:13298:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790736337.937235:0:13298:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1790736337.937241:0:13298:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1790736337.937335:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1790736337.937452:0:11186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1790736337.937503:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1790736337.937586:0:5827:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_001: service thread [ffff941605715e00:5827] 1 exiting: rc = 0 00000020:00000080:3.0:1790736337.937743:0:12664:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff941633c50800 for lustre-MDT0000-lwp-OST0001 00000100:00100000:0.0:1790736337.944229:0:5826:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_000: service thread [ffff94161615ca00:5826] 0 exiting: rc = 1 00000100:00100000:2.0:1790736337.950207:0:11185:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_002: service thread [ffff941603810400:11185] 2 exiting: rc = 0 00000100:00100000:3.0:1790736337.950722:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736337.951138:0:5829:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_001: service thread [ffff94160385b600:5829] 1 exiting: rc = 0 00000100:00100000:2.0:1790736337.951202:0:5830:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_002: service thread [ffff94160385ac00:5830] 2 exiting: rc = 0 00000100:00100000:1.0:1790736337.951240:0:8527:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_003: service thread [ffff941637d70800:8527] 3 exiting: rc = 0 00000100:00100000:0.0:1790736337.951743:0:5828:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_000: service thread [ffff941610197200:5828] 0 exiting: rc = 1 00000100:00100000:3.0:1790736337.957172:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957183:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957190:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957195:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957200:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957207:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957213:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957225:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957232:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957238:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957244:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957249:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957255:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957261:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957281:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957289:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957296:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957302:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957307:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957494:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957503:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957508:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957529:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957534:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957539:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957544:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957549:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957555:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957560:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957565:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957570:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957576:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957581:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957587:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957592:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957597:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957602:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957608:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957615:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957623:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957630:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957637:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957643:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957649:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957653:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957659:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957665:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957669:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957674:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957679:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957685:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957690:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957696:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957701:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957706:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957712:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957717:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957731:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957737:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957742:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957748:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957753:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957759:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736337.957764:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1790736337.966666:0:13298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790736337.966680:0:13298:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1790736337.966686:0:13298:0:(genops.c:885:class_export_put()) final put ffff941635c17000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1790736337.966690:0:13298:0:(genops.c:844:class_export_destroy()) destroying export ffff941635c17000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1790736337.966702:0:13298:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1790736337.966759:0:13298:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94162d364800 1 00000020:00000080:3.0:1790736337.966766:0:13298:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6aae200528fe60d1 00000020:00000080:3.0:1790736337.966773:0:13298:0:(genops.c:885:class_export_put()) final put ffff94163fa03000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1790736337.966796:0:13298:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1790736337.966801:0:13298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790736337.966805:0:13298:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790736337.966809:0:13298:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff94163400b380) has no exports 00000020:00000080:2.0:1790736337.966900:0:12664:0:(genops.c:844:class_export_destroy()) destroying export ffff94163fa03000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1790736338.008866:0:13298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790736338.008941:0:13298:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1790736338.008947:0:13298:0:(genops.c:885:class_export_put()) final put ffff94162d365000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1790736338.008951:0:13298:0:(genops.c:844:class_export_destroy()) destroying export ffff94162d365000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1790736338.008960:0:13298:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1790736338.009225:0:13298:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff94162d360000 00000020:01000000:2.0:1790736338.009248:0:13298:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1790736338.009252:0:13298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790736338.009257:0:13298:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790736338.009261:0:13298:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff941612f419c0) has no exports 00000020:00000080:2.0:1790736338.010430:0:13298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790736338.010441:0:13298:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1790736338.010444:0:13298:0:(genops.c:885:class_export_put()) final put ffff94162d351800/OSS_uuid 00000020:00000080:2.0:1790736338.010448:0:13298:0:(genops.c:844:class_export_destroy()) destroying export ffff94162d351800/OSS_uuid for OSS 00000020:01000000:2.0:1790736338.010453:0:13298:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1790736338.010712:0:8632:0:(service.c:3206:ptlrpc_main()) ll_ost00_003: service thread [ffff941612fdac00:8632] 3 exiting: rc = 0 00000100:00100000:1.0:1790736338.011161:0:6699:0:(service.c:3206:ptlrpc_main()) ll_ost00_002: service thread [ffff94161810a000:6699] 2 exiting: rc = 0 00000100:00100000:0.0:1790736338.011164:0:6697:0:(service.c:3206:ptlrpc_main()) ll_ost00_000: service thread [ffff94163c616000:6697] 0 exiting: rc = 1 00000100:00100000:1.0:1790736338.011241:0:6698:0:(service.c:3206:ptlrpc_main()) ll_ost00_001: service thread [ffff94162edd4000:6698] 1 exiting: rc = 0 00000100:00100000:2.0:1790736338.011303:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.011555:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.011565:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.011572:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.011577:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.011583:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.011588:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.011593:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.011608:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.011614:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.011619:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.011624:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.011629:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.011634:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.011639:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.011644:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.011649:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.011654:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.011660:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.011665:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.011670:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.011675:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.011681:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.011687:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.011694:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.011701:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.011707:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.011715:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.011722:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.011732:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.011846:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.011852:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.011857:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.012246:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.012254:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.012296:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.012303:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.012308:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.012533:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.012542:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.012652:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.012658:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.012808:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.012859:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.012865:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.012871:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.012938:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.012943:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.012950:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.012955:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.012971:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.012977:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.012982:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.012987:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.012992:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.012997:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.013001:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.013006:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.013011:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.013016:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.013031:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.013038:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.013043:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.013049:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:3.0:1790736338.015122:0:5839:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1790736338.015584:0:6702:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_001: service thread [ffff94161810be00:6702] 1 exiting: rc = 0 00000100:00100000:1.0:1790736338.016384:0:6701:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_000: service thread [ffff94162edd4c00:6701] 0 exiting: rc = 1 00000100:00100000:2.0:1790736338.018470:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018481:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018487:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018492:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018497:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018502:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018507:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018512:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018517:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018522:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018527:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018532:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018538:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018558:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018564:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018569:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018574:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018579:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018585:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018590:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018595:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018599:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018604:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018609:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018613:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018619:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018624:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018629:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018635:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018640:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018646:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018651:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018657:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018662:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018668:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018674:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018679:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018684:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018689:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018695:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018700:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018706:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018712:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018718:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018723:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018729:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018735:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018740:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018754:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018760:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018765:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018771:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018776:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018781:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018787:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018793:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018798:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018803:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018809:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018815:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018820:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018825:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018831:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.018836:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.021804:0:6704:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_001: service thread [ffff94161810a400:6704] 1 exiting: rc = 0 00000100:00100000:3.0:1790736338.022633:0:6705:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9416111b6800:6705] 2 exiting: rc = 0 00000100:00100000:3.0:1790736338.026748:0:6703:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_000: service thread [ffff94161810b200:6703] 0 exiting: rc = 1 00000100:00100000:2.0:1790736338.027533:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.027557:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.027566:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.027573:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.027579:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.027588:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.027595:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.027604:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.027612:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.027622:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.027631:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.027640:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.027647:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.027657:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.027672:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.028580:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.028587:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.028593:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.028614:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.028622:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.028627:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.028633:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.028640:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.028646:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.028653:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.028677:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.028684:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.028690:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.028696:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.028702:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.028707:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.028712:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.028718:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.028725:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.028731:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.028736:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.028741:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.028746:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.028752:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.028758:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.028763:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.028770:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.028776:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.028781:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.028787:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.028792:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.028798:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.028804:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.028810:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.028830:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.028838:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.028844:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.028851:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.028865:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.028871:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.029502:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.029514:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.029519:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.029525:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.029532:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.029538:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.029544:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.029549:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.029554:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.038311:0:6706:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9416111b6200:6706] 0 exiting: rc = 1 00000100:00100000:2.0:1790736338.039241:0:6707:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff941610196600:6707] 1 exiting: rc = 0 00000100:00100000:3.0:1790736338.039332:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039341:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039346:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039352:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039359:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039364:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039369:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039374:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039379:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039384:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039389:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039411:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039416:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039420:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039425:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039430:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039435:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039440:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039445:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039450:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039455:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039460:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039466:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039471:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039478:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039483:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039488:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039492:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039497:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039502:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039508:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039513:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039518:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039522:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039528:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039533:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039539:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039544:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039550:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039555:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039560:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039565:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039570:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039575:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039580:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039585:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039598:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039603:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039609:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039614:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039619:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039624:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039629:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039635:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039640:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039645:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039651:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039656:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039661:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039679:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039691:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039697:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039702:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.039707:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790736338.040579:0:6708:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9416055fd400:6708] 0 exiting: rc = 1 00000100:00100000:2.0:1790736338.043241:0:6709:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_001: service thread [ffff941604d24800:6709] 1 exiting: rc = 0 00000100:00100000:3.0:1790736338.043611:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043620:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043626:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043632:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043638:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043644:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043650:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043656:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043662:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043697:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043705:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043710:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043716:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043722:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043727:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043733:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043739:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043758:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043764:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043770:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043775:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043794:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043801:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043807:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043812:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043818:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043823:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043829:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043834:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043840:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043845:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043850:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043856:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043875:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043881:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043887:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043892:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043898:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043908:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043913:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043919:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043925:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043931:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043937:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043942:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043963:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043982:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043989:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.043994:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.044000:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.044005:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.044011:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.044034:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.044041:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.044047:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.044052:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.044058:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.044078:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.044084:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.044090:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.044115:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.044121:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.044127:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790736338.044142:0:13298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1790736338.059388:0:13298:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1790736355.488472:0:13916:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg305-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1790736364.498131:0:14378:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790736364.498136:0:14378:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1790736364.498272:0:14378:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff94163af23800 00000020:01000004:2.0:1790736364.498300:0:14378:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1790736364.498308:0:14378:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1790736364.498322:0:14378:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff941637f6b380) 00000020:00000080:2.0:1790736364.498333:0:14378:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1790736364.525140:0:14378:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1790736364.542240:0:14378:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1790736364.542682:0:14378:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1790736364.542748:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 325: rc = 0 00100000:10000000:3.0:1790736364.542906:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 325: rc = 0 00100000:10000000:3.0:1790736364.542999:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 325: rc = 0 00100000:10000000:3.0:1790736364.543124:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 325: rc = 0 00100000:10000000:3.0:1790736364.543222:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 325: rc = 0 00100000:10000000:3.0:1790736364.543322:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 325: rc = 0 00100000:10000000:3.0:1790736364.543558:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 327: rc = 0 00100000:10000000:3.0:1790736364.550968:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 640: rc = 0 00100000:10000000:3.0:1790736364.551084:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 640: rc = 0 00100000:10000000:2.0:1790736364.554258:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 644: rc = 0 00100000:10000000:0.0:1790736364.559628:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 644: rc = 0 00100000:10000000:0.0:1790736364.560203:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 644: rc = 0 00100000:10000000:0.0:1790736364.560651:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 644: rc = 0 00100000:10000000:1.0:1790736364.561374:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 644: rc = 0 00100000:10000000:1.0:1790736364.561631:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 644: rc = 0 00100000:10000000:1.0:1790736364.563501:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 644: rc = 0 00100000:10000000:1.0:1790736364.563862:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 644: rc = 0 00100000:10000000:1.0:1790736364.564650:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 644: rc = 0 00100000:10000000:1.0:1790736364.564950:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 644: rc = 0 00100000:10000000:1.0:1790736364.565255:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 644: rc = 0 00100000:10000000:1.0:1790736364.566029:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 644: rc = 0 00100000:10000000:1.0:1790736364.566624:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 603: rc = 0 00100000:10000000:1.0:1790736364.567080:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 603: rc = 0 00100000:10000000:1.0:1790736364.567510:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 603: rc = 0 00100000:10000000:1.0:1790736364.571925:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 603: rc = 0 00100000:10000000:1.0:1790736364.572248:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 603: rc = 0 00100000:10000000:1.0:1790736364.572514:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 603: rc = 0 00100000:10000000:1.0:1790736364.572778:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 603: rc = 0 00100000:10000000:1.0:1790736364.573034:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 603: rc = 0 00100000:10000000:1.0:1790736364.573319:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 603: rc = 0 00100000:10000000:1.0:1790736364.573557:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 603: rc = 0 00100000:10000000:1.0:1790736364.573804:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 603: rc = 0 00100000:10000000:1.0:1790736364.574059:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 603: rc = 0 00100000:10000000:1.0:1790736364.574294:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 603: rc = 0 00100000:10000000:1.0:1790736364.574489:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 603: rc = 0 00100000:10000000:1.0:1790736364.574707:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 603: rc = 0 00100000:10000000:1.0:1790736364.576586:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 603: rc = 0 00100000:10000000:1.0:1790736364.577029:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 603: rc = 0 00100000:10000000:1.0:1790736364.577448:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 603: rc = 0 00100000:10000000:1.0:1790736364.578142:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 603: rc = 0 00100000:10000000:1.0:1790736364.578418:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 603: rc = 0 00100000:10000000:1.0:1790736364.578673:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 603: rc = 0 00100000:10000000:1.0:1790736364.578954:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 603: rc = 0 00100000:10000000:1.0:1790736364.579268:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 603: rc = 0 00100000:10000000:1.0:1790736364.579518:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 603: rc = 0 00100000:10000000:1.0:1790736364.579772:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 603: rc = 0 00100000:10000000:1.0:1790736364.585786:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 603: rc = 0 00100000:10000000:1.0:1790736364.587019:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 603: rc = 0 00100000:10000000:1.0:1790736364.587467:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 603: rc = 0 00100000:10000000:1.0:1790736364.588323:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 603: rc = 0 00100000:10000000:1.0:1790736364.591872:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 603: rc = 0 00100000:10000000:2.0:1790736364.600010:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 603: rc = 0 00100000:10000000:2.0:1790736364.601053:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 603: rc = 0 00100000:10000000:2.0:1790736364.603631:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 595: rc = 0 00100000:10000000:2.0:1790736364.604270:0:14378:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1790736364.604447:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 770: rc = 0 00100000:10000000:2.0:1790736364.604638:0:14378:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1790736364.604706:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 770: rc = 0 00100000:10000000:2.0:1790736364.604912:0:14378:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1790736364.604989:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 770: rc = 0 00100000:10000000:2.0:1790736364.605376:0:14378:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1790736364.605442:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 641: rc = 0 00100000:10000000:2.0:1790736364.605624:0:14378:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1790736364.605692:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 641: rc = 0 00100000:10000000:2.0:1790736364.606685:0:14378:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1790736364.606772:0:14378:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 641: rc = 0 00000020:00000080:2.0:1790736364.607054:0:14378:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1790736364.607061:0:14378:0:(osd_handler.c:1577:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790736364.607070:0:14378:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6aae200528fe71e8 00000020:01000004:2.0:1790736364.607078:0:14378:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1790736364.607083:0:14378:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1790736364.607088:0:14378:0:(tgt_mount.c:101:server_register_mount()) register mount ffff94163af23800 from MGS 00000020:01000004:2.0:1790736364.607119:0:14378:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1790736364.607130:0:14378:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff941637f699c0) 00000020:00000080:2.0:1790736364.607140:0:14378:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1790736364.607203:0:14378:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94163af23800 from MGS, refs=2 00080000:01000000:2.0:1790736364.607208:0:14378:0:(osd_handler.c:1577:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790736364.607213:0:14378:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6aae200528fe71f6 00000100:00100000:2.0:1790736364.607307:0:14378:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1790736364.607424:0:14378:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1790736364.607429:0:14378:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1790736364.610491:0:14378:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1790736364.610504:0:14378:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1790736364.611405:0:14378:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790736364.611579:0:14378:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1790736364.611584:0:14378:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1790736364.612989:0:14378:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1790736364.613000:0:14378:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1790736364.614022:0:14378:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1790736364.614032:0:14378:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1790736364.614775:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736364.614779:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736364.614781:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736364.615127:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736364.615131:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736364.615133:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736364.615823:0:14378:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1790736364.618005:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1790736364.654777:0:14378:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1790736364.654796:0:14378:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1790736364.654799:0:14378:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1790736364.658706:0:14387:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1790736364.658965:0:14378:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1790736364.659344:0:14378:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790736364.665751:0:14378:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1790736364.666413:0:14378:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790736364.667414:0:14378:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1790736364.667423:0:14378:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1790736364.669389:0:14378:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1790736364.669400:0:14378:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1790736364.674529:0:14378:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1790736364.674542:0:14378:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:0.0:1790736364.679746:0:14392:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:3.0:1790736364.679916:0:14378:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1790736364.679935:0:14378:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.105@tcp' 00000020:01000004:3.0:1790736364.679937:0:14378:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1790736364.679967:0:14378:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.105@tcp (typ=mgc) 00000020:00000080:3.0:1790736364.679981:0:14378:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.105@tcp (ffff94163400cd40) 00000020:00000080:3.0:1790736364.679997:0:14378:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1790736364.680070:0:14378:0:(ldlm_lib.c:102:import_set_conn()) imp ffff941608677800@MGC192.168.203.105@tcp: add connection 192.168.203.105@tcp at head 00010000:00010000:0.0:1790736364.680308:0:14378:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.105@tcp-0 is initialized 00000040:01000000:0.0:1790736364.680314:0:14378:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.105@tcp ctxt 1 is initialized 10000000:01000000:0.0:1790736364.681199:0:14393:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1790736364.681263:0:14378:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.105@tcp (uuid cd61a3fa-9892-475c-9015-fd1ddc473c5e) 00000020:00000080:1.0:1790736364.681282:0:14378:0:(genops.c:1384:class_connect()) connect: client cd61a3fa-9892-475c-9015-fd1ddc473c5e, cookie 0x6aae200528fe7204 00000100:00080000:1.0:1790736364.681293:0:14378:0:(import.c:545:import_select_connection()) MGC192.168.203.105@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790736364.681302:0:14378:0:(import.c:666:import_select_connection()) MGC192.168.203.105@tcp: import ffff941608677800 using connection 192.168.203.105@tcp/0@lo 00000100:00100000:1.0:1790736364.681335:0:14378:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff941642040380 x1877722816140928/t0(0) o250->MGC192.168.203.105@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790736364.681363:0:14378:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import cd61a3fa-9892-475c-9015-fd1ddc473c5e->MGS 00000020:01000004:1.0:1790736364.681382:0:14378:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1790736364.681401:0:14378:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1790736364.681413:0:14378:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff94163b2999c0) 00000020:00000080:1.0:1790736364.681422:0:14378:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1790736364.683416:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941642040380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cd61a3fa-9892-475c-9015-fd1ddc473c5e:3305:1877722816140928:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1790736364.683501:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736364.685928:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816140928 00000100:00100000:2.0:1790736364.685941:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816140928 00000100:00100000:2.0:1790736364.685995:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790736364.686004:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162e4e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3305:x1877722816140928:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1790736364.686032:0:14389:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from cd61a3fa-9892-475c-9015-fd1ddc473c5e@0@lo t0 exp 0000000000000000 cur 436 last 0 00000020:00000080:2.0:1790736364.686061:0:14389:0:(genops.c:1384:class_connect()) connect: client cd61a3fa-9892-475c-9015-fd1ddc473c5e, cookie 0x6aae200528fe7212 00000100:00080000:2.0:1790736364.686257:0:14389:0:(import.c:65:import_set_state_nolock()) ffff94162d350800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790736364.686361:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162e4e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+5:3305:x1877722816140928:12345-0@lo:250:mount.lustre.0 Request processed in 357us (2860us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736364.686370:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790736364.686413:0:3305:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.105@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1790736364.686422:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.105@tcp: connect to target with instance 0 00000100:00080000:2.0:1790736364.686429:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.105@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1790736364.686433:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1790736364.686437:0:3305:0:(import.c:65:import_set_state_nolock()) ffff941608677800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1790736364.686439:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1790736364.686454:0:3305:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1790736364.686459:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941642040380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cd61a3fa-9892-475c-9015-fd1ddc473c5e:3305:1877722816140928:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1790736364.700471:0:14378:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790736364.700678:0:14378:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1790736364.700684:0:14378:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1790736364.709132:0:14378:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1790736364.709146:0:14378:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1790736364.709548:0:14378:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1790736364.709554:0:14378:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1790736364.710392:0:14378:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790736364.710575:0:14378:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1790736364.710580:0:14378:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1790736364.711594:0:14378:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1790736364.711603:0:14378:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1790736364.810744:0:14378:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790736364.811427:0:14378:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1790736364.811449:0:14378:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1790736364.813262:0:14378:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1790736364.813286:0:14378:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1790736364.826520:0:14378:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790736364.826909:0:14378:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790736364.826917:0:14378:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1790736364.827538:0:14378:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790736364.827545:0:14378:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1790736364.828289:0:14378:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790736364.828458:0:14378:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790736364.828463:0:14378:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1790736364.829531:0:14378:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790736364.829540:0:14378:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1790736364.830420:0:14378:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790736364.830580:0:14378:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790736364.830586:0:14378:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1790736364.831529:0:14378:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790736364.831538:0:14378:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1790736364.892355:0:14378:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790736364.892964:0:14378:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1790736364.892972:0:14378:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1790736364.894952:0:14378:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1790736364.894971:0:14378:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1790736364.897127:0:14378:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790736364.897140:0:14378:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1790736364.901689:0:14378:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1790736364.901719:0:14378:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1790736364.901726:0:14378:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.105@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1790736364.901864:0:14378:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.105@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790736364.901898:0:14378:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.105@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1790736364.901906:0:14378:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790736364.901908:0:14378:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790736364.901909:0:14378:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790736364.901911:0:14378:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790736364.901912:0:14378:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790736364.901913:0:14378:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790736364.901914:0:14378:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790736364.901915:0:14378:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790736364.901917:0:14378:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790736364.901919:0:14378:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790736364.901921:0:14378:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1790736364.901923:0:14378:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790736364.901924:0:14378:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790736364.901925:0:14378:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790736364.901926:0:14378:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790736364.901927:0:14378:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790736364.901928:0:14378:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790736364.901929:0:14378:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790736364.901930:0:14378:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790736364.901931:0:14378:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790736364.901933:0:14378:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790736364.901968:0:14378:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1790736364.901988:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633801500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14378:1877722816141056:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790736364.902058:0:14378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736364.902143:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607a19a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790736364.902244:0:14391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816141056 00000100:00100000:1.0:1790736364.902252:0:14391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816141056 00000100:00100000:1.0:1790736364.902293:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790736364.902303:0:14391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162e4e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+5:14378:x1877722816141056:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790736364.902342:0:14391:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790736364.902345:0:14391:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1790736364.902348:0:14391:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1790736364.905349:0:14412:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1790736364.905753:0:14391:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1790736364.907036:0:14413:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1790736364.907042:0:14413:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1790736364.907045:0:14413:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1790736364.907078:0:14413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1790736364.907341:0:14391:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790736364.907351:0:14391:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1790736364.926837:0:14391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162e4e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+5:14378:x1877722816141056:12345-0@lo:253:mount.lustre.0 Request processed in 24518us (24761us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736364.926855:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790736364.926959:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633801500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14378:1877722816141056:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790736364.926983:0:14378:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1790736364.926986:0:14378:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790736364.926988:0:14378:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790736364.926989:0:14378:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790736364.926990:0:14378:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790736364.927005:0:14378:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790736364.927006:0:14378:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790736364.927008:0:14378:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790736364.927009:0:14378:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790736364.927011:0:14378:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790736364.927012:0:14378:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790736364.927032:0:14378:0:(tgt_mount.c:101:server_register_mount()) register mount ffff94163af23800 from lustre-MDT0000 10000000:01000000:3.0:1790736364.927057:0:14378:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1790736364.927060:0:14378:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1790736364.927064:0:14378:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff94163400cd40 10000000:01000000:3.0:1790736364.927068:0:14378:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790736364.927077:0:14378:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff94163400cd40 from 1 10000000:01000000:3.0:1790736364.927080:0:14378:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790736364.927149:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c9c00/0x6aae200528fe7219 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736364.927160:0:14378:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff94162f8c9c00/0x6aae200528fe7219 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736364.927169:0:14378:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff94162f8c9c00/0x6aae200528fe7219 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736364.927188:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633801500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14378:1877722816141184:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790736364.927224:0:14378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736364.927255:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607a19900 going to sleep for 11 seconds 00000100:00100000:0.0:1790736364.927454:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816141184 00000100:00100000:0.0:1790736364.927461:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816141184 00000100:00100000:0.0:1790736364.927501:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790736364.927509:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162e4e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+5:14378:x1877722816141184:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790736364.927523:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736364.927539:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941642172200/0x6aae200528fe7220 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe7219 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736364.927562:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941642172200/0x6aae200528fe7220 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe7219 expref: 6 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736364.927573:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941642172200/0x6aae200528fe7220 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe7219 expref: 6 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736364.927581:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941642172200, rc 0) 00000100:00100000:0.0:1790736364.927673:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162e4e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+6:14378:x1877722816141184:12345-0@lo:101:mount.lustre.0 Request processed in 164us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736364.927688:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790736364.930663:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633801500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14378:1877722816141184:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790736364.930701:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff94162f8c9c00/0x6aae200528fe7219 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe7220 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736364.930713:0:14378:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff94162f8c9c00/0x6aae200528fe7219 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe7220 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736364.930789:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941642042a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14378:1877722816141312:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790736364.930859:0:14378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736364.930902:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611ce2240 going to sleep for 11 seconds 00000100:00100000:0.0:1790736364.931069:0:14391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816141312 00000100:00100000:0.0:1790736364.931076:0:14391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816141312 00000100:00100000:0.0:1790736364.931152:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790736364.931161:0:14391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162e4e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+6:14378:x1877722816141312:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790736364.931405:0:14391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162e4e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+6:14378:x1877722816141312:12345-0@lo:501:mount.lustre.0 Request processed in 244us (543us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790736364.931423:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790736364.931722:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941642042a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14378:1877722816141312:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1790736364.931751:0:14378:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1790736364.931777:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c9c00/0x6aae200528fe7219 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe7220 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736364.931787:0:14378:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff94162f8c9c00/0x6aae200528fe7219 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe7220 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790736364.931808:0:14378:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff94163af23800 10000000:01000000:3.0:1790736364.931813:0:14378:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790736364.931818:0:14378:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff94163af23800 10000000:01000000:3.0:1790736364.931820:0:14378:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1790736364.931833:0:14378:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff94163af23800 from 1 10000000:01000000:3.0:1790736364.931836:0:14378:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1790736364.931864:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c9800/0x6aae200528fe7227 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736364.931871:0:14378:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff94162f8c9800/0x6aae200528fe7227 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736364.931879:0:14378:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff94162f8c9800/0x6aae200528fe7227 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736364.931892:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633800380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14378:1877722816141440:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790736364.931921:0:14378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736364.931948:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607a19540 going to sleep for 11 seconds 00000100:00100000:3.0:1790736364.931968:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816141440 00000100:00100000:3.0:1790736364.931982:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816141440 00000100:00100000:3.0:1790736364.932009:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790736364.932015:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162e4e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+6:14378:x1877722816141440:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790736364.932023:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736364.932036:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94162f8c8600/0x6aae200528fe722e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe7227 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736364.932054:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94162f8c8600/0x6aae200528fe722e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe7227 expref: 7 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736364.932073:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94162f8c8600/0x6aae200528fe722e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe7227 expref: 7 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736364.932081:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c8600, rc 0) 00000100:00100000:3.0:1790736364.932126:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162e4e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+7:14378:x1877722816141440:12345-0@lo:101:mount.lustre.0 Request processed in 111us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736364.932132:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790736364.932164:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633800380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14378:1877722816141440:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790736364.932174:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff94162f8c9800/0x6aae200528fe7227 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe722e expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736364.932182:0:14378:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff94162f8c9800/0x6aae200528fe7227 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe722e expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790736364.932192:0:14378:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1790736364.932196:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c9800/0x6aae200528fe7227 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe722e expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736364.932202:0:14378:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff94162f8c9800/0x6aae200528fe7227 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe722e expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790736364.932208:0:14378:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1790736364.932211:0:14378:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790736364.932215:0:14378:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff94163af23800 10000000:01000000:3.0:1790736364.932218:0:14378:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1790736364.932221:0:14378:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1790736364.932223:0:14378:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790736364.932243:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c9e00/0x6aae200528fe7235 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736364.932250:0:14378:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff94162f8c9e00/0x6aae200528fe7235 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736364.932257:0:14378:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff94162f8c9e00/0x6aae200528fe7235 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736364.932269:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633800380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14378:1877722816141568:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790736364.932293:0:14378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736364.932312:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607a19540 going to sleep for 11 seconds 00000100:00100000:3.0:1790736364.932324:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816141568 00000100:00100000:3.0:1790736364.932328:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816141568 00000100:00100000:3.0:1790736364.932348:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790736364.932354:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162e4e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+7:14378:x1877722816141568:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790736364.932361:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736364.932368:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94162f8c9600/0x6aae200528fe723c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe7235 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736364.932381:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94162f8c9600/0x6aae200528fe723c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe7235 expref: 8 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736364.932388:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94162f8c9600/0x6aae200528fe723c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe7235 expref: 8 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736364.932394:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c9600, rc 0) 00000100:00100000:3.0:1790736364.932436:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162e4e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+8:14378:x1877722816141568:12345-0@lo:101:mount.lustre.0 Request processed in 81us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736364.932452:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790736364.932493:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633800380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14378:1877722816141568:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790736364.932504:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff94162f8c9e00/0x6aae200528fe7235 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe723c expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736364.932511:0:14378:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff94162f8c9e00/0x6aae200528fe7235 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe723c expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736364.932552:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633800380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14378:1877722816141696:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790736364.932575:0:14378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736364.932588:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607a19540 going to sleep for 11 seconds 00000100:00100000:3.0:1790736364.932600:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816141696 00000100:00100000:3.0:1790736364.932603:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816141696 00000100:00100000:3.0:1790736364.932622:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790736364.932627:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162e4e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+8:14378:x1877722816141696:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790736364.932961:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162e4e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+9:14378:x1877722816141696:12345-0@lo:501:mount.lustre.0 Request processed in 332us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736364.932968:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790736364.933002:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633800380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14378:1877722816141696:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790736364.933026:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633800380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14378:1877722816141824:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790736364.933064:0:14378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736364.933076:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607a19540 going to sleep for 11 seconds 00000100:00100000:3.0:1790736364.933088:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816141824 00000100:00100000:3.0:1790736364.933123:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816141824 00000100:00100000:3.0:1790736364.933146:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790736364.933152:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162e4e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+9:14378:x1877722816141824:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790736364.933415:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162e4e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+9:14378:x1877722816141824:12345-0@lo:503:mount.lustre.0 Request processed in 262us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736364.933427:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790736364.933467:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633800380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14378:1877722816141824:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790736364.937225:0:14414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14414:1877722816141952:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790736364.937313:0:14414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736364.937361:0:14414:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416016359c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790736364.937862:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816141952 00000100:00100000:3.0:1790736364.937872:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816141952 00000100:00100000:3.0:1790736364.937924:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790736364.937933:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162e4e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+9:14414:x1877722816141952:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790736364.938467:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162e4e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+9:14414:x1877722816141952:12345-0@lo:502:llog_process_th.0 Request processed in 533us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736364.938476:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790736364.939184:0:14414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14414:1877722816141952:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790736364.939221:0:14414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790736364.939233:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790736364.939236:0:14414:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1790736364.939241:0:14414:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1790736364.939244:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790736364.939258:0:14414:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff94163b298000) 00000020:00000080:1.0:1790736364.939276:0:14414:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1790736364.939289:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1790736364.939357:0:14414:0:(osd_handler.c:1577:osd_obd_connect()) connect #2 00000020:00000080:1.0:1790736364.939366:0:14414:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6aae200528fe724a 00000020:00000080:1.0:1790736364.939635:0:14414:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1790736364.939640:0:14414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790736364.939643:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790736364.939644:0:14414:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1790736364.939647:0:14414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790736364.939651:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790736364.939652:0:14414:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1790736364.939655:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790736364.939663:0:14414:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff94163b29cd40) 00000020:00000080:1.0:1790736364.939674:0:14414:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1790736364.939678:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1790736364.939680:0:14414:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1790736364.939755:0:14414:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1790736364.939764:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790736364.939805:0:14414:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94163af23800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1790736364.939819:0:14414:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff94163b29b380) 00000020:00000080:1.0:1790736364.939840:0:14414:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1790736364.939956:0:14414:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1790736364.939962:0:14414:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6aae200528fe725f 00000020:00000080:1.0:1790736364.940195:0:14414:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1790736364.940202:0:14414:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1790736364.940208:0:14414:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x6aae200528fe7266 00080000:01000000:1.0:1790736364.940213:0:14414:0:(osd_handler.c:1577:osd_obd_connect()) connect #3 00000020:00000080:1.0:1790736364.940216:0:14414:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6aae200528fe726d 00010000:00010000:2.0:1790736365.065915:0:14414:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1790736365.066622:0:14414:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1790736365.066806:0:14414:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1790736365.067526:0:14414:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff941637f68000) 00000020:00000080:2.0:1790736365.067546:0:14414:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1790736365.067607:0:14414:0:(osd_handler.c:1577:osd_obd_connect()) connect #4 00000020:00000080:2.0:1790736365.067614:0:14414:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6aae200528fe727b 00000020:00000080:3.0:1790736365.075890:0:14414:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1790736365.084710:0:14414:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x6aae200528fe7282 00000020:00000080:3.0:1790736365.085133:0:14414:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1790736365.085145:0:14414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790736365.085150:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790736365.085152:0:14414:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1790736365.085156:0:14414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790736365.085163:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790736365.085165:0:14414:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1790736365.085169:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1790736365.085202:0:14414:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1790736365.085216:0:14414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790736365.085219:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790736365.085221:0:14414:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1790736365.085223:0:14414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790736365.085225:0:14414:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:3.0:1790736365.085226:0:14414:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790736365.085228:0:14414:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790736365.085230:0:14414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790736365.085232:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790736365.085239:0:14414:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790736365.085243:0:14414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790736365.085246:0:14414:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1790736365.085250:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790736365.085251:0:14414:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1790736365.085254:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790736365.085260:0:14414:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.105@tcp to nid 0x20000c0a8cb69 (192.168.203.105@tcp) 00000020:01000000:3.0:1790736365.085294:0:14414:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1790736365.085297:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790736365.085311:0:14414:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9416340099c0) 00000020:00000080:3.0:1790736365.085324:0:14414:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1790736365.085329:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790736365.085378:0:14414:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1790736365.085384:0:14414:0:(osd_handler.c:1577:osd_obd_connect()) connect #5 00000020:00000080:3.0:1790736365.085389:0:14414:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6aae200528fe7290 00010000:00080000:3.0:1790736365.085426:0:14414:0:(ldlm_lib.c:102:import_set_conn()) imp ffff941606685800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.105@tcp at head 00010000:00010000:3.0:1790736365.085633:0:14414:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1790736365.085955:0:14414:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1790736365.086277:0:14414:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1790736365.087702:0:14414:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790736365.087766:0:14414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1790736365.087862:0:14414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1790736365.091759:0:14418:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790736365.091777:0:14418:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1790736365.093172:0:14414:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790736365.093186:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1790736365.093220:0:14414:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1790736365.093239:0:14414:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6aae200528fe7297 00000100:00080000:3.0:1790736365.093249:0:14414:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790736365.093259:0:14414:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff941606685800 using connection 192.168.203.105@tcp/0@lo 00000100:00100000:3.0:1790736365.093293:0:14414:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff941633800380 x1877722816142080/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790736365.093369:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633800380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1877722816142080:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1790736365.093458:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877722816142080 offset 0 length 520: 4 00000100:00080000:3.0:1790736365.093528:0:14414:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1790736365.093607:0:14414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790736365.093612:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790736365.093614:0:14414:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1790736365.093617:0:14414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790736365.093621:0:14414:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1790736365.093622:0:14414:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790736365.093624:0:14414:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790736365.093626:0:14414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790736365.093628:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790736365.093630:0:14414:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790736365.093632:0:14414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790736365.093636:0:14414:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1790736365.093640:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790736365.093641:0:14414:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1790736365.093644:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790736365.093648:0:14414:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.105@tcp to nid 0x20000c0a8cb69 (192.168.203.105@tcp) 00000020:01000000:3.0:1790736365.093681:0:14414:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1790736365.093684:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790736365.093697:0:14414:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff94163400b380) 00000020:00000080:3.0:1790736365.093709:0:14414:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1790736365.093715:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790736365.093778:0:14414:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1790736365.093783:0:14414:0:(osd_handler.c:1577:osd_obd_connect()) connect #6 00000020:00000080:3.0:1790736365.093789:0:14414:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6aae200528fe72a5 00010000:00080000:3.0:1790736365.093822:0:14414:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94161196b800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.105@tcp at head 00010000:00010000:3.0:1790736365.095498:0:14414:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1790736365.095712:0:14414:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1790736365.095731:0:14414:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1790736365.096475:0:14414:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790736365.096545:0:14414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1790736365.096629:0:14414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:1.0:1790736365.097549:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790736365.097566:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941642043800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd61a3fa-9892-475c-9015-fd1ddc473c5e:3309:1877722816142208:0@lo:400:kworker.0 00000100:00100000:1.0:1790736365.097647:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736365.097702:0:14391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816142208 00000100:00100000:1.0:1790736365.097710:0:14391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816142208 00000100:00100000:1.0:1790736365.097752:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790736365.097771:0:14391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162e4e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+9:3309:x1877722816142208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736365.097834:0:14391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162e4e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+9:3309:x1877722816142208:12345-0@lo:400:kworker.0 Request processed in 55us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736365.097842:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790736365.097906:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941642043800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd61a3fa-9892-475c-9015-fd1ddc473c5e:3309:1877722816142208:0@lo:400:kworker.0 00000040:00080000:1.0:1790736365.102082:0:14420:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1790736365.102088:0:14420:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1790736365.103290:0:14414:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790736365.103302:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790736365.103337:0:14414:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1790736365.103355:0:14414:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6aae200528fe72ac 00000100:00080000:0.0:1790736365.103365:0:14414:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790736365.103375:0:14414:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff94161196b800 using connection 192.168.203.105@tcp/0@lo 00000100:00100000:0.0:1790736365.103560:0:14414:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94163fae1880 x1877722816142336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790736365.103619:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1877722816142336:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1790736365.103692:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877722816142336 offset 0 length 520: 4 00000100:00080000:0.0:1790736365.103750:0:14414:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1790736365.103808:0:14414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790736365.103812:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790736365.103814:0:14414:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1790736365.103817:0:14414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790736365.103821:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790736365.103832:0:14414:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790736365.103836:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790736365.103837:0:14414:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1790736365.103840:0:14414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790736365.103842:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790736365.103850:0:14414:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1790736365.103853:0:14414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790736365.103856:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790736365.103858:0:14414:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790736365.103861:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1790736365.103899:0:14414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14414:1877722816142464:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790736365.103947:0:14414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736365.103991:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816142464 00000100:00100000:0.0:1790736365.103997:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816142464 00000100:00100000:0.0:1790736365.104032:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790736365.104041:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162e4e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+9:14414:x1877722816142464:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790736365.104274:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162e4e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+9:14414:x1877722816142464:12345-0@lo:502:llog_process_th.0 Request processed in 234us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736365.104282:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790736365.104315:0:14414:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611cf5180 going to sleep for 11 seconds 00000100:00100000:0.0:1790736365.104332:0:14414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14414:1877722816142464:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790736365.104354:0:14414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790736365.104357:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790736365.104359:0:14414:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790736365.104362:0:14414:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1790736365.104913:0:14378:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1790736365.104940:0:14378:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1790736365.104963:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c9e00/0x6aae200528fe7235 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe723c expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736365.105086:0:14378:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff94162f8c9e00/0x6aae200528fe7235 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe723c expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790736365.105120:0:14378:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94163af23800 from 1 10000000:01000000:3.0:1790736365.105123:0:14378:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790736365.105153:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c8000/0x6aae200528fe72b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736365.105161:0:14378:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff94162f8c8000/0x6aae200528fe72b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736365.105170:0:14378:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff94162f8c8000/0x6aae200528fe72b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736365.105187:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633802a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14378:1877722816142592:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790736365.105225:0:14378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736365.105254:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff94161813d480 going to sleep for 11 seconds 00000100:00100000:0.0:1790736365.105320:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816142592 00000100:00100000:0.0:1790736365.105326:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816142592 00000100:00100000:0.0:1790736365.105352:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790736365.105360:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162e4e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+9:14378:x1877722816142592:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790736365.105370:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736365.105382:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941642173c00/0x6aae200528fe72ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe72b3 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736365.105404:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941642173c00/0x6aae200528fe72ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe72b3 expref: 10 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736365.105433:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941642173c00/0x6aae200528fe72ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe72b3 expref: 10 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736365.105559:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941642173c00, rc 0) 00000100:00100000:0.0:1790736365.105605:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162e4e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+10:14378:x1877722816142592:12345-0@lo:101:mount.lustre.0 Request processed in 245us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736365.105611:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790736365.105758:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633802a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14378:1877722816142592:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790736365.105771:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff94162f8c8000/0x6aae200528fe72b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe72ba expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736365.105780:0:14378:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff94162f8c8000/0x6aae200528fe72b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe72ba expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736365.107230:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633802a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14378:1877722816142720:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1790736365.107300:0:14378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736365.107345:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff94161813d480 going to sleep for 11 seconds 00000100:00100000:0.0:1790736365.109329:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816142720 00000100:00100000:0.0:1790736365.109344:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816142720 00000100:00100000:0.0:1790736365.109408:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790736365.109417:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162e4e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+10:14378:x1877722816142720:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1790736365.109443:0:14389:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1790736365.109448:0:14389:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1790736365.109656:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162e4e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+10:14378:x1877722816142720:12345-0@lo:256:mount.lustre.0 Request processed in 235us (2352us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736365.109664:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790736365.109726:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633802a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14378:1877722816142720:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1790736365.110423:0:14378:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790736365.110443:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c8000/0x6aae200528fe72b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe72ba expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736365.110456:0:14378:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff94162f8c8000/0x6aae200528fe72b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe72ba expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790736365.110465:0:14378:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94163af23800 from 1 10000000:01000000:3.0:1790736365.110468:0:14378:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790736365.110500:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c9a00/0x6aae200528fe72c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736365.110508:0:14378:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff94162f8c9a00/0x6aae200528fe72c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736365.110516:0:14378:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff94162f8c9a00/0x6aae200528fe72c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736365.110535:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633802a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14378:1877722816142848:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790736365.110575:0:14378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736365.110617:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff94161813d480 going to sleep for 11 seconds 00000100:00100000:1.0:1790736365.110764:0:14391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816142848 00000100:00100000:1.0:1790736365.110771:0:14391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816142848 00000100:00100000:1.0:1790736365.110816:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790736365.110832:0:14391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162e4e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+10:14378:x1877722816142848:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790736365.110845:0:14391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736365.110860:0:14391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941633c60400/0x6aae200528fe72c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe72c1 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736365.110881:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941633c60400/0x6aae200528fe72c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe72c1 expref: 11 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736365.110891:0:14391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941633c60400/0x6aae200528fe72c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe72c1 expref: 11 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736365.110898:0:14391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c60400, rc 0) 00000100:00100000:1.0:1790736365.110932:0:14391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162e4e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+11:14378:x1877722816142848:12345-0@lo:101:mount.lustre.0 Request processed in 110us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736365.110938:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790736365.112000:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633802a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14378:1877722816142848:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790736365.112023:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff94162f8c9a00/0x6aae200528fe72c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe72c8 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736365.112055:0:14378:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff94162f8c9a00/0x6aae200528fe72c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe72c8 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736365.112302:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633802a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14378:1877722816142976:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790736365.112349:0:14378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736365.112379:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff94161813d480 going to sleep for 11 seconds 00000100:00100000:1.0:1790736365.112550:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816142976 00000100:00100000:1.0:1790736365.112557:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816142976 00000100:00100000:1.0:1790736365.112601:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790736365.112619:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162e4e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+11:14378:x1877722816142976:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790736365.113202:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162e4e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+11:14378:x1877722816142976:12345-0@lo:501:mount.lustre.0 Request processed in 583us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736365.113210:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790736365.113307:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633802a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14378:1877722816142976:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790736365.113342:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633802a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14378:1877722816143104:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790736365.113378:0:14378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736365.113694:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff94161813d480 going to sleep for 11 seconds 00000100:00100000:0.0:1790736365.115240:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816143104 00000100:00100000:0.0:1790736365.115253:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816143104 00000100:00100000:0.0:1790736365.115360:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790736365.115370:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162e4e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+11:14378:x1877722816143104:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790736365.115612:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162e4e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+11:14378:x1877722816143104:12345-0@lo:503:mount.lustre.0 Request processed in 243us (2232us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736365.115620:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790736365.115650:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633802a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14378:1877722816143104:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790736365.116519:0:14422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633802a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14422:1877722816143232:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790736365.116700:0:14422:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736365.116739:0:14422:0:(client.c:2716:ptlrpc_set_wait()) set ffff94161813d300 going to sleep for 11 seconds 00000100:00100000:1.0:1790736365.116790:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816143232 00000100:00100000:1.0:1790736365.116796:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816143232 00000100:00100000:1.0:1790736365.116869:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790736365.116877:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941615e69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+11:14422:x1877722816143232:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790736365.117123:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941615e69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+11:14422:x1877722816143232:12345-0@lo:502:llog_process_th.0 Request processed in 246us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736365.117131:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790736365.117205:0:14422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633802a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14422:1877722816143232:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790736365.117228:0:14422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790736365.117237:0:14422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790736365.117239:0:14422:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790736365.117245:0:14422:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94163af23800 00000020:00000080:3.0:1790736365.117249:0:14422:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790736365.117256:0:14422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790736365.117258:0:14422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790736365.117260:0:14422:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1790736365.117262:0:14422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790736365.117265:0:14422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790736365.117271:0:14422:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790736365.117275:0:14422:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94163af23800 00000020:00000080:3.0:1790736365.117277:0:14422:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790736365.117327:0:14422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790736365.117330:0:14422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790736365.117332:0:14422:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1790736365.117334:0:14422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790736365.117337:0:14422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790736365.117338:0:14422:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790736365.117341:0:14422:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94163af23800 00000020:00000080:3.0:1790736365.117343:0:14422:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790736365.117374:0:14422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633802a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14422:1877722816143360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790736365.117406:0:14422:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736365.121369:0:14391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816143360 00000100:00100000:2.0:1790736365.121384:0:14391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816143360 00000100:00100000:2.0:1790736365.121432:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790736365.121440:0:14391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+11:14422:x1877722816143360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790736365.121745:0:14391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+11:14422:x1877722816143360:12345-0@lo:502:llog_process_th.0 Request processed in 305us (4338us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736365.121753:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790736365.128793:0:14422:0:(client.c:2716:ptlrpc_set_wait()) set ffff94161813d300 going to sleep for 11 seconds 00000100:00100000:3.0:1790736365.128845:0:14422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633802a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14422:1877722816143360:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790736365.128883:0:14422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790736365.128892:0:14422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790736365.128894:0:14422:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1790736365.128898:0:14422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1790736365.129249:0:14378:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1790736365.129270:0:14378:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790736365.129286:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c9a00/0x6aae200528fe72c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe72c8 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736365.129305:0:14378:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff94162f8c9a00/0x6aae200528fe72c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe72c8 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790736365.129347:0:14378:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790736365.129349:0:14378:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff94163af23800 10000000:01000000:0.0:1790736365.129352:0:14378:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff94163af23800 10000000:01000000:0.0:1790736365.129356:0:14378:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790736365.129361:0:14378:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94163af23800 from 1 10000000:01000000:0.0:1790736365.129364:0:14378:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790736365.129394:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff941642173e00/0x6aae200528fe72cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736365.129402:0:14378:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff941642173e00/0x6aae200528fe72cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736365.129411:0:14378:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff941642173e00/0x6aae200528fe72cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736365.129429:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14378:1877722816143488:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790736365.129487:0:14378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736365.133005:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607a19a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790736365.138056:0:14391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816143488 00000100:00100000:3.0:1790736365.138070:0:14391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816143488 00000100:00100000:3.0:1790736365.138196:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790736365.138207:0:14391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+11:14378:x1877722816143488:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790736365.138223:0:14391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736365.138239:0:14391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94162f8c9000/0x6aae200528fe72d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe72cf expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736365.138267:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94162f8c9000/0x6aae200528fe72d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe72cf expref: 12 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736365.138289:0:14391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94162f8c9000/0x6aae200528fe72d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe72cf expref: 12 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736365.138297:0:14391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c9000, rc 0) 00000100:00100000:3.0:1790736365.138372:0:14391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+12:14378:x1877722816143488:12345-0@lo:101:mount.lustre.0 Request processed in 168us (8886us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736365.138380:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790736365.138493:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14378:1877722816143488:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790736365.138511:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff941642173e00/0x6aae200528fe72cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe72d6 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736365.138521:0:14378:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff941642173e00/0x6aae200528fe72cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe72d6 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736365.139083:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14378:1877722816143616:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790736365.139191:0:14378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736365.139227:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607a19a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790736365.139900:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816143616 00000100:00100000:3.0:1790736365.139909:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816143616 00000100:00100000:3.0:1790736365.139956:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790736365.139965:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+12:14378:x1877722816143616:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790736365.140244:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+12:14378:x1877722816143616:12345-0@lo:501:mount.lustre.0 Request processed in 280us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736365.140252:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790736365.141077:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14378:1877722816143616:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790736365.141167:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14378:1877722816143744:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790736365.141217:0:14378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736365.141252:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607a19a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790736365.144043:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816143744 00000100:00100000:3.0:1790736365.144057:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816143744 00000100:00100000:3.0:1790736365.144136:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790736365.144147:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+12:14378:x1877722816143744:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790736365.144376:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+12:14378:x1877722816143744:12345-0@lo:503:mount.lustre.0 Request processed in 231us (3158us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736365.144385:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790736365.144582:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14378:1877722816143744:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790736365.145306:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14428:1877722816143872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790736365.145356:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736365.145390:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607d78180 going to sleep for 11 seconds 00000100:00100000:3.0:1790736365.145434:0:14391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816143872 00000100:00100000:3.0:1790736365.145440:0:14391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816143872 00000100:00100000:3.0:1790736365.145475:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790736365.145484:0:14391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+12:14428:x1877722816143872:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790736365.145682:0:14391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+12:14428:x1877722816143872:12345-0@lo:502:llog_process_th.0 Request processed in 198us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736365.145696:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790736365.147353:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14428:1877722816143872:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1790736365.147424:0:14428:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1790736365.147449:0:14428:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff94163da78000) 00000020:00000080:1.0:1790736365.147468:0:14428:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1790736365.147560:0:14428:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94163af23800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1790736365.147564:0:14428:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94163af23800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1790736365.147567:0:14428:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94163af23800 4 00010000:00080000:1.0:1790736365.147595:0:14428:0:(ldlm_lib.c:102:import_set_conn()) imp ffff941635cd8800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.105@tcp at head 00010000:00010000:1.0:1790736365.152175:0:14428:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1790736365.156391:0:14428:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1790736365.156429:0:14428:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790736365.156440:0:14428:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x6aae200528fe72e4 00000100:00080000:1.0:1790736365.156451:0:14428:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790736365.156462:0:14428:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff941635cd8800 using connection 192.168.203.105@tcp/0@lo 00000100:00100000:1.0:1790736365.156502:0:14428:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff941642043800 x1877722816144000/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790736365.156539:0:14428:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1790736365.158890:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941642043800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877722816144000:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790736365.158966:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736365.159224:0:14396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816144000 00000100:00100000:0.0:1790736365.159232:0:14396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816144000 00000100:00100000:0.0:1790736365.159289:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790736365.159296:0:14396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1877722816144000:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790736365.159350:0:14396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1877722816144000:12345-0@lo:38:llog_process_th.0 Request processed in 54us (384us total) trans 0 rc -11/-11 00000100:00100000:0.0:1790736365.159356:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790736365.160185:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790736365.160193:0:3305:0:(import.c:65:import_set_state_nolock()) ffff941635cd8800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790736365.160198:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1790736365.160202:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941642043800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877722816144000:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790736365.161591:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941642041c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14428:1877722816144128:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790736365.161657:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736365.161698:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611ce2600 going to sleep for 11 seconds 00000100:00100000:3.0:1790736365.161754:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816144128 00000100:00100000:3.0:1790736365.161759:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816144128 00000100:00100000:3.0:1790736365.161929:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790736365.161937:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+12:14428:x1877722816144128:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790736365.162207:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+12:14428:x1877722816144128:12345-0@lo:502:llog_process_th.0 Request processed in 271us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736365.162215:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790736365.162290:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941642041c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14428:1877722816144128:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1790736365.162312:0:14428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1790736365.162564:0:14378:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1790736365.162584:0:14378:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790736365.162605:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff941642173e00/0x6aae200528fe72cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe72d6 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736365.162617:0:14378:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff941642173e00/0x6aae200528fe72cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe72d6 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790736365.162668:0:14378:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790736365.162670:0:14378:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790736365.162671:0:14378:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790736365.162673:0:14378:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790736365.162674:0:14378:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790736365.162675:0:14378:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790736365.162677:0:14378:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790736365.162678:0:14378:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790736365.162680:0:14378:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790736365.162681:0:14378:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790736365.162684:0:14378:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1790736365.162686:0:14378:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790736365.162687:0:14378:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790736365.162688:0:14378:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790736365.162689:0:14378:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790736365.162690:0:14378:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790736365.162691:0:14378:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790736365.162692:0:14378:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790736365.162693:0:14378:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790736365.162694:0:14378:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790736365.162695:0:14378:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790736365.162716:0:14378:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1790736365.162726:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14378:1877722816144256:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790736365.162754:0:14378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736365.162788:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607d78e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790736365.163021:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816144256 00000100:00100000:2.0:1790736365.163027:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816144256 00000100:00100000:2.0:1790736365.163055:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790736365.163063:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+12:14378:x1877722816144256:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790736365.163114:0:14390:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1790736365.163127:0:14390:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1790736365.200924:0:14390:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790736365.200942:0:14390:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1790736365.201849:0:14412:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1790736365.201855:0:14412:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1790736365.201878:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff941633c60800/0x6aae200528fe72eb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736365.201897:0:14412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff941642173c00/0x6aae200528fe72ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe72b3 expref: 12 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736365.201905:0:14412:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff941633c60800/0x6aae200528fe72eb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736365.201944:0:14412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff941642173c00/0x6aae200528fe72ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6aae200528fe72b3 expref: 12 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736365.201959:0:14412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff941642173c00/0x6aae200528fe72ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6aae200528fe72b3 expref: 12 pid: 14389 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736365.201972:0:14412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941642043100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14412:1877722816144384:0@lo:104: 00000100:00100000:1.0:1790736365.202035:0:14412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736365.202152:0:14412:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611ce2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790736365.203706:0:14379:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816144384 00000100:00100000:0.0:1790736365.203719:0:14379:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816144384 00000100:00100000:0.0:1790736365.203771:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790736365.203782:0:14379:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642040e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+3:14412:x1877722816144384:12345-0@lo:104: 00010000:00010000:0.0:1790736365.203799:0:14379:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff94162f8c8000/0x6aae200528fe72b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe72ba expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736365.203907:0:14379:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790736365.203913:0:14379:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642040e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+3:14412:x1877722816144384:12345-0@lo:104: Request processed in 135us (1879us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736365.203921:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1790736365.203941:0:14385:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790736365.203947:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff94162f8c8000/0x6aae200528fe72b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe72ba expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736365.203954:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c8000 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:0.0:1790736365.203958:0:14385:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff94162f8c8000/0x6aae200528fe72b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6aae200528fe72ba expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736365.203966:0:14385:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff94162f8c8000/0x6aae200528fe72b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6aae200528fe72ba expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790736365.203974:0:14385:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff94162f8c8000/0x6aae200528fe72b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6aae200528fe72ba expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790736365.203979:0:14385:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790736365.204014:0:14385:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff94162f8c8000/0x6aae200528fe72b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe72ba expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736365.204020:0:14385:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790736365.204040:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff94162f8c8000/0x6aae200528fe72b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe72ba expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736365.204047:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff94162f8c8000/0x6aae200528fe72b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe72ba expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736365.204075:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736365.204077:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736365.204079:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790736365.204130:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd61a3fa-9892-475c-9015-fd1ddc473c5e:3309:1877722816144512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790736365.204172:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736365.204244:0:14381:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816144512 00000100:00100000:0.0:1790736365.204248:0:14381:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816144512 00010000:00010000:0.0:1790736365.204264:0:14381:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff941642173c00/0x6aae200528fe72ba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe72b3 expref: 13 pid: 14389 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736365.204284:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790736365.204291:0:14381:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+13:3309:x1877722816144512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790736365.204300:0:14381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790736365.204305:0:14381:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff941642173c00/0x6aae200528fe72ba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe72b3 expref: 13 pid: 14389 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736365.204314:0:14381:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff941642173c00/0x6aae200528fe72ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6aae200528fe72b3 expref: 13 pid: 14389 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736365.204331:0:14381:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff941633c60800/0x6aae200528fe72eb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736365.204338:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941633c60800/0x6aae200528fe72eb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790736365.204351:0:14381:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002496010s 00010000:00010000:0.0:1790736365.204356:0:14381:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff941633c60800/0x6aae200528fe72eb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736365.204372:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff941633c60800/0x6aae200528fe72eb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736365.204379:0:14381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff941633c60800/0x6aae200528fe72eb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736365.204385:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff941633c60800/0x6aae200528fe72eb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736365.204390:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60800 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:0.0:1790736365.204395:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff941633c60800/0x6aae200528fe72eb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736365.204402:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff941633c60800/0x6aae200528fe72eb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736365.204410:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff941633c60800/0x6aae200528fe72eb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736365.204419:0:14381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790736365.204448:0:14381:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+13:3309:x1877722816144512:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736365.204455:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1790736365.204491:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941642173c00/0x6aae200528fe72ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6aae200528fe72b3 expref: 12 pid: 14389 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736365.204501:0:14412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941642043100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14412:1877722816144384:0@lo:104: 00010000:00010000:0.0:1790736365.204519:0:14412:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff941633c60800/0x6aae200528fe72eb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736365.204536:0:14412:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff941633c60800/0x6aae200528fe72eb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736365.204541:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff941633c60800/0x6aae200528fe72eb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736365.204547:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941633c60800/0x6aae200528fe72eb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736365.204574:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd61a3fa-9892-475c-9015-fd1ddc473c5e:3309:1877722816144512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790736365.211784:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+11:14378:x1877722816144256:12345-0@lo:253:mount.lustre.0 Request processed in 48712us (49020us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736365.211798:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790736365.211915:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14378:1877722816144256:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790736365.211931:0:14378:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1790736365.211934:0:14378:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790736365.211936:0:14378:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790736365.211938:0:14378:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790736365.211939:0:14378:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790736365.211940:0:14378:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790736365.211941:0:14378:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790736365.211942:0:14378:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790736365.211944:0:14378:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790736365.211947:0:14378:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790736365.211948:0:14378:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790736365.211962:0:14378:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1790736365.217061:0:14378:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1790736365.217324:0:14378:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1790736365.217617:0:14378:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1790736365.217851:0:14378:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1790736365.218313:0:14378:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1790736365.218491:0:14378:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1790736365.221510:0:14378:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1790736365.221674:0:14378:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1790736365.221940:0:14378:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1790736365.222191:0:14378:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1790736365.222469:0:14378:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1790736365.222631:0:14378:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1790736365.248389:0:14378:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1790736365.248869:0:14378:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1790736365.249389:0:14434:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1790736365.249393:0:14434:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1790736365.249506:0:14435:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1790736365.249573:0:14435:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790736365.253615:0:14435:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1790736365.253683:0:14435:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1790736365.253687:0:14435:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1790736365.254373:0:14378:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1790736365.254502:0:14378:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1790736365.255266:0:14378:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1790736365.255276:0:14378:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1790736365.255419:0:14378:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790736365.256613:0:14378:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1790736365.257466:0:14378:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1790736365.257504:0:14378:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1790736365.259241:0:14378:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1790736365.266634:0:14378:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1790736365.307891:0:14378:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1790736365.307928:0:14378:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb2d3c1cab988 00100000:10000000:1.0:1790736365.307937:0:14378:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1790736365.309840:0:14378:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790736365.309854:0:14378:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.105@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790736365.309869:0:14378:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1790736365.309888:0:14378:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1790736365.653330:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790736365.912698:0:14393:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790736365.912705:0:14393:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94163af23800 from 6 10000000:01000000:0.0:1790736365.912710:0:14393:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790736365.912758:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff941642173c00/0x6aae200528fe72f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736365.912769:0:14393:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff941642173c00/0x6aae200528fe72f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736365.912797:0:14393:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff941642173c00/0x6aae200528fe72f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736365.912833:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14393:1877722816144640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790736365.912905:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736365.912968:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607d78240 going to sleep for 11 seconds 00000100:00100000:0.0:1790736365.914904:0:14391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816144640 00000100:00100000:0.0:1790736365.914918:0:14391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816144640 00000100:00100000:0.0:1790736365.914988:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790736365.914997:0:14391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+11:14393:x1877722816144640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790736365.915014:0:14391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736365.915034:0:14391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941642173200/0x6aae200528fe72f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe72f2 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736365.915060:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941642173200/0x6aae200528fe72f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe72f2 expref: 12 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736365.915070:0:14391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941642173200/0x6aae200528fe72f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe72f2 expref: 12 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736365.915079:0:14391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941642173200, rc 0) 00000100:00100000:0.0:1790736365.915161:0:14391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+12:14393:x1877722816144640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (2255us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736365.915168:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790736365.915219:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14393:1877722816144640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790736365.915236:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff941642173c00/0x6aae200528fe72f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe72f9 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736365.915258:0:14393:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff941642173c00/0x6aae200528fe72f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe72f9 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736365.915316:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14393:1877722816144768:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790736365.915352:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736365.915371:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607d78240 going to sleep for 11 seconds 00000100:00100000:0.0:1790736365.915385:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816144768 00000100:00100000:0.0:1790736365.915388:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816144768 00000100:00100000:0.0:1790736365.915409:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790736365.915416:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+12:14393:x1877722816144768:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790736365.915428:0:14390:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790736365.915444:0:14390:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790736365.915446:0:14390:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1790736365.916667:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+12:14393:x1877722816144768:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1245us (1308us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736365.916677:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790736365.916808:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14393:1877722816144768:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1790736365.916871:0:14393:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790736365.916880:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff941642173c00/0x6aae200528fe72f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe72f9 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736365.916890:0:14393:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff941642173c00/0x6aae200528fe72f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe72f9 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790736366.168704:0:14427:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790736366.677383:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790736367.196753:0:14427:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790736367.701244:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736368.731555:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736369.757389:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790736370.326166:0:12664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790736370.326186:0:12664:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790736370.326189:0:12664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790736370.326204:0:12664:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790736370.326207:0:12664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1790736370.326210:0:12664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1790736370.326214:0:12664:0:(import.c:65:import_set_state_nolock()) ffff941635cd8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790736370.326229:0:12664:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff941635cd8800 using connection 192.168.203.105@tcp/0@lo 00000100:00100000:3.0:1790736370.326253:0:12664:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff941633803800 x1877722816145024/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790736370.326312:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877722816145024:0@lo:38:kworker.0 00000100:00100000:3.0:1790736370.326374:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736370.326673:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd61a3fa-9892-475c-9015-fd1ddc473c5e:3306:1877722816144896:0@lo:400:kworker.0 00000100:00100000:0.0:1790736370.326707:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736370.326746:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816144896 00000100:00100000:0.0:1790736370.326752:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816144896 00000100:00100000:0.0:1790736370.327054:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790736370.327065:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+12:3306:x1877722816144896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736370.327134:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+12:3306:x1877722816144896:12345-0@lo:400:kworker.0 Request processed in 70us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736370.327141:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790736370.327186:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd61a3fa-9892-475c-9015-fd1ddc473c5e:3306:1877722816144896:0@lo:400:kworker.0 00000100:00100000:1.0:1790736370.328404:0:14398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816145024 00000100:00100000:1.0:1790736370.328416:0:14398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816145024 00000100:00100000:1.0:1790736370.328454:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790736370.328461:0:14398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633802d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1877722816145024:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1790736370.328486:0:14398:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 442 last 0 00000020:00000080:1.0:1790736370.328519:0:14398:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x6aae200528fe7300 00000004:00100000:1.0:1790736370.328534:0:14398:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790736370.328660:0:14398:0:(import.c:65:import_set_state_nolock()) ffff941635cdf000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790736370.328726:0:14398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633802d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877722816145024:12345-0@lo:38:kworker.0 Request processed in 264us (2351us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736370.328734:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790736370.328779:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff941633803800 x1877722816145024/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790736380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790736370.330129:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1790736370.330139:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1790736370.330152:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790736370.330155:0:3305:0:(import.c:65:import_set_state_nolock()) ffff941635cd8800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790736370.330163:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877722816145024:0@lo:38:kworker.0 00000001:02000400:2.0:1790736370.473910:0:14677:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg305-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790736370.779889:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736371.798247:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736372.823038:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790736373.535363:0:14828:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffbb9edcf0 20000000:00000080:1.0:1790736373.535385:0:14828:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff94163da6f800 uarg=0000000000000000 20000000:01000000:1.0:1790736373.535424:0:14828:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1790736373.535431:0:14828:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1790736373.535436:0:14828:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1790736373.541180:0:14829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1790736373.542687:0:14828:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1790736373.556812:0:14828:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790736373.556910:0:14828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94162f8c8c00/0x6aae200528fe7307 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736373.556930:0:14828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff941633c60400/0x6aae200528fe72c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe72c1 expref: 11 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736373.557032:0:14828:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94162f8c8c00/0x6aae200528fe7307 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736373.557080:0:14828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff941633c60400/0x6aae200528fe72c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6aae200528fe72c1 expref: 11 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736373.557129:0:14828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff941633c60400/0x6aae200528fe72c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6aae200528fe72c1 expref: 11 pid: 14391 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736373.557144:0:14828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633803800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14828:1877722816145152:0@lo:104: 00000100:00100000:3.0:1790736373.557204:0:14828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736373.557262:0:14828:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611ce2180 going to sleep for 11 seconds 00000100:00100000:1.0:1790736373.558362:0:14380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816145152 00000100:00100000:1.0:1790736373.558373:0:14380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816145152 00000100:00100000:1.0:1790736373.558439:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790736373.558449:0:14380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633802a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+3:14828:x1877722816145152:12345-0@lo:104: 00010000:00010000:1.0:1790736373.558464:0:14380:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff94162f8c9a00/0x6aae200528fe72c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe72c8 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736373.558539:0:14380:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790736373.558545:0:14380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633802a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+3:14828:x1877722816145152:12345-0@lo:104: Request processed in 99us (1342us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736373.558553:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1790736373.558575:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790736373.558582:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff94162f8c9a00/0x6aae200528fe72c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe72c8 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736373.558588:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c9a00 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:1.0:1790736373.558602:0:14384:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff94162f8c9a00/0x6aae200528fe72c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6aae200528fe72c8 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736373.558610:0:14384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff94162f8c9a00/0x6aae200528fe72c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6aae200528fe72c8 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790736373.558618:0:14384:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff94162f8c9a00/0x6aae200528fe72c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6aae200528fe72c8 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790736373.558624:0:14384:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790736373.558655:0:14384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff94162f8c9a00/0x6aae200528fe72c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe72c8 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736373.558662:0:14384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790736373.558682:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff94162f8c9a00/0x6aae200528fe72c1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe72c8 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736373.558689:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff94162f8c9a00/0x6aae200528fe72c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe72c8 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736373.558719:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736373.558721:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736373.558723:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736373.558742:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941642042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd61a3fa-9892-475c-9015-fd1ddc473c5e:3307:1877722816145280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790736373.558791:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736373.558840:0:14381:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816145280 00000100:00100000:1.0:1790736373.558844:0:14381:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816145280 00010000:00010000:1.0:1790736373.558860:0:14381:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff941633c60400/0x6aae200528fe72c8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe72c1 expref: 12 pid: 14391 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736373.558879:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790736373.558995:0:14828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633803800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14828:1877722816145152:0@lo:104: 00010000:00010000:3.0:1790736373.559016:0:14828:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94162f8c8c00/0x6aae200528fe7307 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736373.559324:0:14381:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642042300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+12:3307:x1877722816145280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790736373.559338:0:14381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736373.559344:0:14381:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff941633c60400/0x6aae200528fe72c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe72c1 expref: 12 pid: 14391 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736373.559355:0:14381:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff941633c60400/0x6aae200528fe72c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6aae200528fe72c1 expref: 12 pid: 14391 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736373.559368:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941633c60400/0x6aae200528fe72c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6aae200528fe72c1 expref: 12 pid: 14391 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736373.559382:0:14381:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94162f8c8c00/0x6aae200528fe7307 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736373.559390:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94162f8c8c00/0x6aae200528fe7307 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736373.559405:0:14381:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94162f8c8c00/0x6aae200528fe7307 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736373.559412:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94162f8c8c00/0x6aae200528fe7307 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736373.559418:0:14381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94162f8c8c00/0x6aae200528fe7307 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736373.559424:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94162f8c8c00/0x6aae200528fe7307 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736373.559430:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c8c00 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:1.0:1790736373.559433:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94162f8c8c00/0x6aae200528fe7307 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736373.559449:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94162f8c8c00/0x6aae200528fe7307 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736373.568033:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94162f8c8c00/0x6aae200528fe7307 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736373.568060:0:14381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790736373.568234:0:14828:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94162f8c8c00/0x6aae200528fe7307 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736373.568244:0:14828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94162f8c8c00/0x6aae200528fe7307 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736373.568252:0:14828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94162f8c8c00/0x6aae200528fe7307 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736373.569011:0:14381:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642042300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+11:3307:x1877722816145280:12345-0@lo:103:ldlm_bl.0 Request processed in 10115us (10214us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736373.569022:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790736373.569179:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941642042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd61a3fa-9892-475c-9015-fd1ddc473c5e:3307:1877722816145280:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790736373.845367:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736374.878261:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790736375.381917:0:14393:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790736375.381926:0:14393:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94163af23800 from 10 10000000:01000000:0.0:1790736375.381932:0:14393:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790736375.381979:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff941642173000/0x6aae200528fe730e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736375.381990:0:14393:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff941642173000/0x6aae200528fe730e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736375.382002:0:14393:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff941642173000/0x6aae200528fe730e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736375.382026:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14393:1877722816145408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790736375.382111:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736375.382174:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff941633e2ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1790736375.382205:0:14391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816145408 00000100:00100000:0.0:1790736375.382211:0:14391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816145408 00000100:00100000:0.0:1790736375.382259:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790736375.382266:0:14391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+11:14393:x1877722816145408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790736375.382280:0:14391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736375.382292:0:14391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941642172400/0x6aae200528fe7315 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe730e expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736375.382315:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941642172400/0x6aae200528fe7315 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe730e expref: 12 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736375.382325:0:14391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941642172400/0x6aae200528fe7315 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe730e expref: 12 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736375.382332:0:14391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941642172400, rc 0) 00000100:00100000:0.0:1790736375.382369:0:14391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+12:14393:x1877722816145408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736375.382375:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790736375.382421:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14393:1877722816145408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790736375.382434:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff941642173000/0x6aae200528fe730e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe7315 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736375.382442:0:14393:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff941642173000/0x6aae200528fe730e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe7315 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736375.382493:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14393:1877722816145536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790736375.382516:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736375.382537:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff941633e2ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1790736375.382548:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816145536 00000100:00100000:0.0:1790736375.382552:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816145536 00000100:00100000:0.0:1790736375.382571:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790736375.382577:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+12:14393:x1877722816145536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790736375.382830:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+12:14393:x1877722816145536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 253us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736375.382837:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790736375.382868:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14393:1877722816145536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790736375.382892:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14393:1877722816145664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790736375.382926:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736375.382938:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff941633e2ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1790736375.382949:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816145664 00000100:00100000:0.0:1790736375.382952:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816145664 00000100:00100000:0.0:1790736375.382971:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790736375.382977:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+12:14393:x1877722816145664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790736375.383125:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+12:14393:x1877722816145664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736375.383130:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790736375.383168:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14393:1877722816145664:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790736375.383820:0:14893:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1790736375.383878:0:14393:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1790736375.383892:0:14393:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790736375.383901:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff941642173000/0x6aae200528fe730e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe7315 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736375.383924:0:14393:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff941642173000/0x6aae200528fe730e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe7315 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1790736375.448206:0:12664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790736375.448217:0:12664:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790736375.448219:0:12664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790736375.448222:0:12664:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790736375.448323:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877722816145792:0@lo:400:kworker.0 00000100:00100000:0.0:1790736375.448404:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736375.448571:0:14396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816145792 00000100:00100000:3.0:1790736375.448579:0:14396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816145792 00000100:00100000:3.0:1790736375.448637:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790736375.448648:0:14396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877722816145792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736375.448699:0:14396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877722816145792:12345-0@lo:400:kworker.0 Request processed in 54us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736375.448706:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1790736375.448881:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff941633803800 x1877722816145792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790736391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790736375.448895:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877722816145792:0@lo:400:kworker.0 00000100:00100000:3.0:1790736375.454961:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790736365/real 1790736365] req@ffff94163fae1880 x1877722816142336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790736375 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736375.454990:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94163fae1880 x1877722816142336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790736375 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736375.455010:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790736365/real 1790736365] req@ffff941633800380 x1877722816142080/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790736375 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736375.455021:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff941633800380 x1877722816142080/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790736375 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790736375.455037:0:3305:0:(import.c:65:import_set_state_nolock()) ffff94161196b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790736375.455054:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790736375.455058:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1877722816142336:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1790736375.455063:0:3305:0:(import.c:65:import_set_state_nolock()) ffff941606685800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790736375.455068:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790736375.455071:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633800380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1877722816142080:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1790736375.455725:0:12664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790736375.455731:0:12664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1790736375.455734:0:12664:0:(import.c:65:import_set_state_nolock()) ffff941606685800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790736375.455739:0:12664:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 437 00000100:00080000:2.0:1790736375.455745:0:12664:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790736375.455769:0:12664:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff941606685800 using connection 192.168.203.105@tcp/0@lo 00000100:00100000:2.0:1790736375.455811:0:12664:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94162f265180 x1877722816145920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790736375.455838:0:12664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790736375.455841:0:12664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790736375.455842:0:12664:0:(import.c:65:import_set_state_nolock()) ffff94161196b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790736375.455845:0:12664:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 437 00000100:00080000:2.0:1790736375.455856:0:12664:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790736375.455860:0:12664:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff94161196b800 using connection 192.168.203.105@tcp/0@lo 00000100:00100000:2.0:1790736375.455873:0:12664:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94162f265500 x1877722816146048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790736375.456119:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1877722816145920:0@lo:8:kworker.0 00000400:00000100:3.0:1790736375.456171:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877722816145920 offset 0 length 520: 4 00000100:00100000:3.0:1790736375.456212:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1877722816146048:0@lo:8:kworker.0 00000400:00000100:3.0:1790736375.456247:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877722816146048 offset 0 length 520: 4 00010000:00010000:1.0:1790736375.893256:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736376.925210:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790736377.440698:0:14427:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790736377.942968:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790736378.800036:0:15077:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790736378.800040:0:15077:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1790736378.800257:0:15077:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff941637ef8000 00000020:01000004:2.0:1790736378.800282:0:15077:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1790736378.800294:0:15077:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1790736378.800307:0:15077:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff941637f6cd40) 00000020:00000080:2.0:1790736378.800322:0:15077:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1790736378.834046:0:15077:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1790736378.835901:0:15077:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1790736378.838893:0:15077:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1790736378.839760:0:15077:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1790736378.840063:0:15077:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1790736378.843049:0:15077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1790736378.843658:0:15077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1790736378.843770:0:15077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1790736378.845008:0:15077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 647: rc = 0 00100000:10000000:2.0:1790736378.845564:0:15077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 647: rc = 0 00100000:10000000:2.0:1790736378.846497:0:15077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 647: rc = 0 00100000:10000000:2.0:1790736378.846883:0:15077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 647: rc = 0 00100000:10000000:2.0:1790736378.847764:0:15077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 647: rc = 0 00100000:10000000:2.0:1790736378.848380:0:15077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 647: rc = 0 00000020:00000080:3.0:1790736378.855666:0:15077:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1790736378.855679:0:15077:0:(osd_handler.c:1577:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790736378.855691:0:15077:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6aae200528fe7323 00000020:01000004:3.0:1790736378.855699:0:15077:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1790736378.855717:0:15077:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.105@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1790736378.855720:0:15077:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.105@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1790736378.855737:0:15077:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1790736378.855741:0:15077:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1790736378.855753:0:15077:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff941634008000) 00000020:00000080:3.0:1790736378.855771:0:15077:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1790736378.857119:0:15077:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790736378.857567:0:15077:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1790736378.857575:0:15077:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1790736378.858466:0:15077:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1790736378.858474:0:15077:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1790736378.862134:0:15077:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1790736378.862149:0:15077:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1790736378.872310:0:15077:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790736378.872508:0:15077:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1790736378.872514:0:15077:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1790736378.873422:0:15077:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1790736378.873432:0:15077:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1790736378.943930:0:15077:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790736378.944502:0:15077:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1790736378.944510:0:15077:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1790736378.947497:0:15077:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1790736378.947510:0:15077:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1790736378.950773:0:15077:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790736378.950788:0:15077:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1790736378.954930:0:15077:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790736378.955171:0:15077:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1790736378.955177:0:15077:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1790736378.960340:0:15077:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1790736378.960353:0:15077:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:0.0:1790736378.965440:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736379.006525:0:15077:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790736379.008832:0:15077:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1790736379.008841:0:15077:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1790736379.010487:0:15077:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1790736379.010506:0:15077:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1790736379.011387:0:15077:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1790736379.011412:0:15077:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1790736379.011928:0:15077:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.105@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1790736379.030042:0:15077:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.105@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790736379.030077:0:15077:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.105@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1790736379.030082:0:15077:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790736379.030083:0:15077:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790736379.030085:0:15077:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790736379.030086:0:15077:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790736379.030087:0:15077:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790736379.030089:0:15077:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790736379.030090:0:15077:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790736379.030134:0:15077:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790736379.030136:0:15077:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790736379.030139:0:15077:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1790736379.030141:0:15077:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790736379.030143:0:15077:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790736379.030144:0:15077:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790736379.030145:0:15077:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790736379.030146:0:15077:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790736379.030147:0:15077:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790736379.030148:0:15077:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790736379.030149:0:15077:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790736379.030150:0:15077:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790736379.030189:0:15077:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790736379.030208:0:15077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f266300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15077:1877722816146176:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790736379.030417:0:15077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736379.030541:0:15077:0:(client.c:2716:ptlrpc_set_wait()) set ffff941612fd10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790736379.032486:0:14391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816146176 00000100:00100000:1.0:1790736379.032500:0:14391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816146176 00000100:00100000:1.0:1790736379.032618:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790736379.032629:0:14391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+12:15077:x1877722816146176:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790736379.032667:0:14391:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1790736379.032671:0:14391:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1790736379.032674:0:14391:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1790736379.052520:0:14391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+12:15077:x1877722816146176:12345-0@lo:253:mount.lustre.0 Request processed in 19883us (22093us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736379.052534:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790736379.052707:0:15077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f266300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15077:1877722816146176:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790736379.052734:0:15077:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1790736379.052737:0:15077:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790736379.052739:0:15077:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790736379.052741:0:15077:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790736379.052742:0:15077:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790736379.052743:0:15077:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790736379.052744:0:15077:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790736379.052746:0:15077:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790736379.052747:0:15077:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790736379.052749:0:15077:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790736379.052770:0:15077:0:(tgt_mount.c:101:server_register_mount()) register mount ffff941637ef8000 from lustre-OST0000 10000000:01000000:2.0:1790736379.052800:0:15077:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1790736379.052803:0:15077:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1790736379.052810:0:15077:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff94163400cd40 local copy 00010000:00010000:2.0:1790736379.052822:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c9c00/0x6aae200528fe7219 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe7220 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736379.053078:0:15077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f266300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15077:1877722816146304:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790736379.053346:0:15077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736379.053433:0:15077:0:(client.c:2716:ptlrpc_set_wait()) set ffff941612fd1600 going to sleep for 11 seconds 00000100:00100000:0.0:1790736379.054334:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816146304 00000100:00100000:0.0:1790736379.054653:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816146304 00000100:00100000:0.0:1790736379.054781:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790736379.054791:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+12:15077:x1877722816146304:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790736379.055064:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+12:15077:x1877722816146304:12345-0@lo:501:mount.lustre.0 Request processed in 274us (1717us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790736379.055072:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790736379.055365:0:15077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f266300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15077:1877722816146304:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1790736379.055387:0:15077:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.105@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790736379.055796:0:15077:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.105@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790736379.055807:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c9c00/0x6aae200528fe7219 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe7220 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736379.055818:0:15077:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff94162f8c9c00/0x6aae200528fe7219 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe7220 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790736379.055846:0:15077:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff941637ef8000 10000000:01000000:3.0:1790736379.055851:0:15077:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790736379.055856:0:15077:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff94163400cd40 10000000:01000000:3.0:1790736379.055859:0:15077:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1790736379.055862:0:15077:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff94163400cd40 from 1 10000000:01000000:3.0:1790736379.055866:0:15077:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1790736379.055908:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c8c00/0x6aae200528fe7331 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736379.055917:0:15077:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff94162f8c8c00/0x6aae200528fe7331 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736379.055927:0:15077:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff94162f8c8c00/0x6aae200528fe7331 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736379.055952:0:15077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633800380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15077:1877722816146432:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790736379.055993:0:15077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736379.057401:0:15077:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607d78240 going to sleep for 11 seconds 00000100:00100000:0.0:1790736379.057579:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816146432 00000100:00100000:0.0:1790736379.057588:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816146432 00000100:00100000:0.0:1790736379.057631:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790736379.057641:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+12:15077:x1877722816146432:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790736379.057673:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736379.057693:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941642173600/0x6aae200528fe7338 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe7331 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736379.057720:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941642173600/0x6aae200528fe7338 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe7331 expref: 13 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736379.057741:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941642173600/0x6aae200528fe7338 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe7331 expref: 13 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736379.057750:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941642173600, rc 0) 00000100:00100000:0.0:1790736379.057807:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+13:15077:x1877722816146432:12345-0@lo:101:mount.lustre.0 Request processed in 168us (1813us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736379.057813:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790736379.059406:0:15077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633800380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15077:1877722816146432:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790736379.059431:0:15077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff94162f8c8c00/0x6aae200528fe7331 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe7338 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736379.059441:0:15077:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff94162f8c8c00/0x6aae200528fe7331 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe7338 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790736379.059462:0:15077:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1790736379.059484:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c8c00/0x6aae200528fe7331 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe7338 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736379.059492:0:15077:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff94162f8c8c00/0x6aae200528fe7331 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe7338 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790736379.059500:0:15077:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1790736379.059507:0:15077:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790736379.059513:0:15077:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1790736379.059516:0:15077:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1790736379.059544:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c9200/0x6aae200528fe733f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736379.059552:0:15077:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff94162f8c9200/0x6aae200528fe733f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736379.059573:0:15077:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff94162f8c9200/0x6aae200528fe733f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736379.059606:0:15077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633800380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15077:1877722816146560:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790736379.059655:0:15077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736379.059692:0:15077:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607d78240 going to sleep for 11 seconds 00000100:00100000:0.0:1790736379.059853:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816146560 00000100:00100000:0.0:1790736379.059861:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816146560 00000100:00100000:0.0:1790736379.059896:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790736379.059917:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635c1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+13:15077:x1877722816146560:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790736379.059930:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736379.059944:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9416013ff600/0x6aae200528fe7346 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe733f expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736379.059965:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9416013ff600/0x6aae200528fe7346 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe733f expref: 14 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736379.059974:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9416013ff600/0x6aae200528fe7346 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe733f expref: 14 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736379.059981:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9416013ff600, rc 0) 00000100:00100000:0.0:1790736379.060037:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635c1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+14:15077:x1877722816146560:12345-0@lo:101:mount.lustre.0 Request processed in 121us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736379.060043:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790736379.060258:0:15077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633800380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15077:1877722816146560:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790736379.060270:0:15077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff94162f8c9200/0x6aae200528fe733f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe7346 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736379.060278:0:15077:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff94162f8c9200/0x6aae200528fe733f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe7346 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790736379.061040:0:15077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1790736379.064538:0:15077:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790736379.064890:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1790736379.064940:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1790736379.064994:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1790736379.065050:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1790736379.065089:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1790736379.066022:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1790736379.067770:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1790736379.067790:0:15077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1790736379.067892:0:15077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633800380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15077:1877722816146688:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790736379.068031:0:15077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736379.068083:0:15077:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607d78180 going to sleep for 11 seconds 00000100:00100000:0.0:1790736379.068262:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816146688 00000100:00100000:0.0:1790736379.068270:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816146688 00000100:00100000:0.0:1790736379.068324:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790736379.068334:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635c1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+14:15077:x1877722816146688:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790736379.068819:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635c1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+14:15077:x1877722816146688:12345-0@lo:501:mount.lustre.0 Request processed in 486us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736379.068828:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790736379.068986:0:15077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633800380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15077:1877722816146688:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790736379.069027:0:15077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633800380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15077:1877722816146816:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790736379.069069:0:15077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736379.069224:0:15077:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607d78180 going to sleep for 11 seconds 00000100:00100000:1.0:1790736379.069292:0:14391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816146816 00000100:00100000:1.0:1790736379.069304:0:14391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816146816 00000100:00100000:1.0:1790736379.069330:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790736379.069337:0:14391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635c1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+14:15077:x1877722816146816:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790736379.070327:0:14391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635c1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+14:15077:x1877722816146816:12345-0@lo:503:mount.lustre.0 Request processed in 986us (1253us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736379.070336:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790736379.073163:0:15077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633800380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15077:1877722816146816:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790736379.074147:0:15077:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790736379.074225:0:15077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15077:1877722816146944:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790736379.074292:0:15077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736379.074343:0:15077:0:(client.c:2716:ptlrpc_set_wait()) set ffff941635cc23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790736379.074568:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816146944 00000100:00100000:2.0:1790736379.074574:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816146944 00000100:00100000:2.0:1790736379.074623:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790736379.074632:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+14:15077:x1877722816146944:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790736379.074857:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+14:15077:x1877722816146944:12345-0@lo:502:mount.lustre.0 Request processed in 225us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736379.074865:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790736379.075051:0:15077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15077:1877722816146944:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790736379.075446:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1790736379.075499:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1790736379.075534:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1790736379.075663:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1790736379.075718:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1790736379.075769:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1790736379.075820:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1790736379.075857:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1790736379.075891:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1790736379.077613:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1790736379.077670:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1790736379.077737:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1790736379.077806:0:15077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15077:1877722816147072:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790736379.077883:0:15077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736379.078006:0:15077:0:(client.c:2716:ptlrpc_set_wait()) set ffff941635cc23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790736379.078774:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816147072 00000100:00100000:2.0:1790736379.078785:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816147072 00000100:00100000:2.0:1790736379.078846:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790736379.078855:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635c1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+14:15077:x1877722816147072:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790736379.079291:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635c1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+14:15077:x1877722816147072:12345-0@lo:502:mount.lustre.0 Request processed in 436us (1407us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736379.079300:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790736379.079487:0:15077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15077:1877722816147072:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790736379.079601:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1790736379.079614:0:15077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1790736379.085219:0:15091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790736379.085234:0:15091:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1790736379.085242:0:15091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790736379.085245:0:15091:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1790736379.085253:0:15091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790736379.085290:0:15091:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff941634ed99c0) 00000020:00000080:2.0:1790736379.085313:0:15091:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1790736379.085321:0:15091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790736379.085385:0:15091:0:(tgt_mount.c:153:server_get_mount()) get mount ffff941637ef8000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1790736379.085394:0:15091:0:(osd_handler.c:1577:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790736379.085400:0:15091:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6aae200528fe7354 00010000:00010000:3.0:1790736379.092878:0:15091:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1790736379.093419:0:15091:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1790736379.099435:0:15091:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1790736379.102439:0:15091:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1790736379.102451:0:15091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790736379.102459:0:15091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790736379.102461:0:15091:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1790736379.102465:0:15091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790736379.102478:0:15091:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1790736379.102480:0:15091:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790736379.102482:0:15091:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790736379.102483:0:15091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790736379.102486:0:15091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790736379.102487:0:15091:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790736379.102490:0:15091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790736379.102492:0:15091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790736379.102494:0:15091:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790736379.102496:0:15091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790736379.102498:0:15091:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790736379.102500:0:15091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790736379.102502:0:15091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790736379.102503:0:15091:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1790736379.102505:0:15091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790736379.102507:0:15091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790736379.102508:0:15091:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790736379.102511:0:15091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1790736379.102587:0:15091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790736379.102592:0:15091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790736379.102593:0:15091:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1790736379.102596:0:15091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1790736379.103392:0:15077:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1790736379.103429:0:15077:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1790736379.103459:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c9200/0x6aae200528fe733f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe7346 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736379.103482:0:15077:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff94162f8c9200/0x6aae200528fe733f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe7346 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790736379.103493:0:15077:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff941637ef8000 from 1 10000000:01000000:1.0:1790736379.103496:0:15077:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790736379.103534:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff941633c60000/0x6aae200528fe735b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736379.103542:0:15077:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff941633c60000/0x6aae200528fe735b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736379.103553:0:15077:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff941633c60000/0x6aae200528fe735b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736379.104288:0:15077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941642040a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15077:1877722816147200:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790736379.104369:0:15077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736379.104475:0:15077:0:(client.c:2716:ptlrpc_set_wait()) set ffff941603887480 going to sleep for 11 seconds 00000100:00100000:2.0:1790736379.109551:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816147200 00000100:00100000:2.0:1790736379.109635:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816147200 00000100:00100000:2.0:1790736379.109743:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790736379.109754:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635c1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+14:15077:x1877722816147200:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790736379.109781:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736379.109806:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94163c527a00/0x6aae200528fe7362 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe735b expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736379.109837:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94163c527a00/0x6aae200528fe7362 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe735b expref: 15 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736379.109849:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94163c527a00/0x6aae200528fe7362 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe735b expref: 15 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736379.109868:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94163c527a00, rc 0) 00000100:00100000:2.0:1790736379.109973:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635c1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+15:15077:x1877722816147200:12345-0@lo:101:mount.lustre.0 Request processed in 220us (5605us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736379.109980:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790736379.110169:0:15077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941642040a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15077:1877722816147200:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790736379.110188:0:15077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff941633c60000/0x6aae200528fe735b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe7362 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736379.110203:0:15077:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff941633c60000/0x6aae200528fe735b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe7362 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790736379.110807:0:15077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1790736379.111139:0:15077:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790736379.111399:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1790736379.111448:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1790736379.111514:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1790736379.111522:0:15077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1790736379.111593:0:15077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633801500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15077:1877722816147328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790736379.111649:0:15077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736379.113141:0:15077:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607d78240 going to sleep for 11 seconds 00000100:00100000:0.0:1790736379.113298:0:14391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816147328 00000100:00100000:0.0:1790736379.113308:0:14391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816147328 00000100:00100000:0.0:1790736379.113352:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790736379.113362:0:14391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635c1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+15:15077:x1877722816147328:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790736379.114546:0:14391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635c1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+15:15077:x1877722816147328:12345-0@lo:501:mount.lustre.0 Request processed in 1179us (2890us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736379.114557:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790736379.114755:0:15077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633801500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15077:1877722816147328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790736379.114826:0:15077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633801500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15077:1877722816147456:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790736379.114876:0:15077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736379.114926:0:15077:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607d78240 going to sleep for 11 seconds 00000100:00100000:3.0:1790736379.114948:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816147456 00000100:00100000:3.0:1790736379.114953:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816147456 00000100:00100000:3.0:1790736379.115855:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790736379.115869:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635c1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+15:15077:x1877722816147456:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790736379.116225:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635c1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+15:15077:x1877722816147456:12345-0@lo:503:mount.lustre.0 Request processed in 359us (1347us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736379.116233:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790736379.116630:0:15077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633801500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15077:1877722816147456:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790736379.123000:0:15077:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790736379.123342:0:15077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633801500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15077:1877722816147584:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790736379.123422:0:15077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736379.123463:0:15077:0:(client.c:2716:ptlrpc_set_wait()) set ffff941607d78240 going to sleep for 11 seconds 00000100:00100000:2.0:1790736379.123587:0:14391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816147584 00000100:00100000:2.0:1790736379.123595:0:14391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816147584 00000100:00100000:2.0:1790736379.123639:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790736379.123648:0:14391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635c1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+15:15077:x1877722816147584:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790736379.124483:0:14391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635c1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+15:15077:x1877722816147584:12345-0@lo:502:mount.lustre.0 Request processed in 823us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736379.124492:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790736379.124750:0:15077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633801500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15077:1877722816147584:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790736379.125422:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1790736379.125649:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1790736379.125707:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1790736379.125839:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1790736379.125982:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1790736379.126046:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1790736379.128643:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1790736379.128710:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1790736379.128764:0:15077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f264380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15077:1877722816147712:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790736379.128975:0:15077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736379.129053:0:15077:0:(client.c:2716:ptlrpc_set_wait()) set ffff941612fd19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790736379.129205:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816147712 00000100:00100000:3.0:1790736379.129212:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816147712 00000100:00100000:3.0:1790736379.129245:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790736379.129251:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635c1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+15:15077:x1877722816147712:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790736379.129434:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635c1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+15:15077:x1877722816147712:12345-0@lo:502:mount.lustre.0 Request processed in 181us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736379.129442:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790736379.129521:0:15077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f264380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15077:1877722816147712:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790736379.129649:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1790736379.129661:0:15077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1790736379.130945:0:15095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790736379.130956:0:15095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790736379.130958:0:15095:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790736379.130966:0:15095:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff941637ef8000 00000020:00000080:0.0:1790736379.130969:0:15095:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790736379.130976:0:15095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790736379.130978:0:15095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790736379.130980:0:15095:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1790736379.130982:0:15095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790736379.130988:0:15095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790736379.130990:0:15095:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790736379.130996:0:15095:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff941637ef8000 00000020:00000080:0.0:1790736379.130998:0:15095:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790736379.131205:0:15095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790736379.131209:0:15095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790736379.131210:0:15095:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1790736379.131217:0:15095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790736379.131230:0:15095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790736379.131231:0:15095:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790736379.131235:0:15095:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff941637ef8000 00000020:00000080:0.0:1790736379.131237:0:15095:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790736379.133347:0:15095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790736379.133359:0:15095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790736379.133361:0:15095:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1790736379.133366:0:15095:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1790736379.141141:0:15077:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1790736379.141192:0:15077:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790736379.141218:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff941633c60000/0x6aae200528fe735b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe7362 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736379.141233:0:15077:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff941633c60000/0x6aae200528fe735b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe7362 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790736379.141283:0:15077:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790736379.141286:0:15077:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff941637ef8000 10000000:01000000:2.0:1790736379.141294:0:15077:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff941637ef8000 10000000:01000000:2.0:1790736379.141298:0:15077:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790736379.141304:0:15077:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff941637ef8000 from 1 10000000:01000000:2.0:1790736379.141307:0:15077:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790736379.141341:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff94163c527c00/0x6aae200528fe7369 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736379.141350:0:15077:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff94163c527c00/0x6aae200528fe7369 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736379.141363:0:15077:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff94163c527c00/0x6aae200528fe7369 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736379.141386:0:15077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f265880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15077:1877722816147840:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790736379.143716:0:15077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736379.143786:0:15077:0:(client.c:2716:ptlrpc_set_wait()) set ffff941612fd1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790736379.143857:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816147840 00000100:00100000:3.0:1790736379.143866:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816147840 00000100:00100000:3.0:1790736379.143916:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790736379.143926:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635c1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+15:15077:x1877722816147840:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790736379.143943:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736379.143962:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94162f8c8400/0x6aae200528fe7370 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe7369 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736379.143992:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94162f8c8400/0x6aae200528fe7370 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe7369 expref: 16 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736379.144018:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94162f8c8400/0x6aae200528fe7370 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe7369 expref: 16 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736379.144027:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c8400, rc 0) 00000100:00100000:3.0:1790736379.144071:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635c1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+16:15077:x1877722816147840:12345-0@lo:101:mount.lustre.0 Request processed in 146us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736379.144077:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790736379.144658:0:15077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f265880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15077:1877722816147840:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790736379.144677:0:15077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff94163c527c00/0x6aae200528fe7369 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe7370 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736379.144688:0:15077:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff94163c527c00/0x6aae200528fe7369 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe7370 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790736379.147626:0:15077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1790736379.148281:0:15077:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790736379.148537:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1790736379.148584:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1790736379.148619:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1790736379.148668:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1790736379.148705:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1790736379.148792:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1790736379.148828:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1790736379.148946:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1790736379.148994:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1790736379.149028:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1790736379.149060:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1790736379.149123:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1790736379.149161:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1790736379.149192:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1790736379.149239:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1790736379.149275:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1790736379.149308:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1790736379.149353:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1790736379.149387:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1790736379.149421:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1790736379.149467:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1790736379.149521:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1790736379.149556:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1790736379.149605:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1790736379.149637:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1790736379.149668:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1790736379.149714:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1790736379.154320:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1790736379.154438:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1790736379.154448:0:15077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1790736379.154550:0:15077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f265880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15077:1877722816147968:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790736379.154615:0:15077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736379.154800:0:15077:0:(client.c:2716:ptlrpc_set_wait()) set ffff941612fd1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790736379.155127:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816147968 00000100:00100000:3.0:1790736379.155135:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816147968 00000100:00100000:3.0:1790736379.155173:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790736379.155182:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+16:15077:x1877722816147968:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790736379.155411:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+16:15077:x1877722816147968:12345-0@lo:501:mount.lustre.0 Request processed in 230us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736379.155419:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790736379.155707:0:15077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f265880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15077:1877722816147968:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790736379.155756:0:15077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f265880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15077:1877722816148096:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790736379.155805:0:15077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736379.155843:0:15077:0:(client.c:2716:ptlrpc_set_wait()) set ffff941612fd1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790736379.156011:0:14391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816148096 00000100:00100000:3.0:1790736379.156017:0:14391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816148096 00000100:00100000:3.0:1790736379.156050:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790736379.156057:0:14391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635c1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+16:15077:x1877722816148096:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790736379.156219:0:14391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635c1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+16:15077:x1877722816148096:12345-0@lo:503:mount.lustre.0 Request processed in 162us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736379.156226:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790736379.156306:0:15077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f265880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15077:1877722816148096:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790736379.158474:0:15077:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790736379.158560:0:15077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f265880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15077:1877722816148224:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790736379.158632:0:15077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736379.159011:0:15077:0:(client.c:2716:ptlrpc_set_wait()) set ffff941612fd1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790736379.159262:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816148224 00000100:00100000:3.0:1790736379.159270:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816148224 00000100:00100000:3.0:1790736379.159309:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790736379.159318:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635c1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+16:15077:x1877722816148224:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790736379.159567:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635c1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+16:15077:x1877722816148224:12345-0@lo:502:mount.lustre.0 Request processed in 248us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736379.159581:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790736379.159683:0:15077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f265880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15077:1877722816148224:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790736379.159978:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1790736379.160028:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1790736379.160064:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1790736379.160141:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1790736379.160181:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1790736379.160246:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1790736379.160285:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1790736379.160320:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1790736379.160371:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1790736379.160408:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1790736379.160442:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1790736379.160512:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1790736379.160551:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1790736379.160585:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1790736379.160633:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1790736379.160670:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1790736379.160704:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1790736379.160769:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1790736379.160802:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1790736379.160836:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1790736379.160900:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1790736379.160952:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1790736379.160989:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1790736379.161039:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1790736379.161076:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1790736379.161132:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1790736379.161181:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1790736379.161220:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1790736379.161256:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1790736379.161304:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1790736379.161342:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1790736379.161378:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1790736379.161409:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1790736379.161457:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1790736379.161493:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1790736379.161541:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1790736379.161578:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1790736379.161630:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1790736379.163309:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1790736379.163378:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1790736379.163433:0:15077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f265880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15077:1877722816148352:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790736379.163515:0:15077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736379.163604:0:15077:0:(client.c:2716:ptlrpc_set_wait()) set ffff941612fd1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790736379.163828:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816148352 00000100:00100000:3.0:1790736379.163836:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816148352 00000100:00100000:3.0:1790736379.163885:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790736379.163895:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635c1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+16:15077:x1877722816148352:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790736379.164141:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635c1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+16:15077:x1877722816148352:12345-0@lo:502:mount.lustre.0 Request processed in 247us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736379.164149:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790736379.164284:0:15077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f265880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15077:1877722816148352:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790736379.164363:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1790736379.164374:0:15077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1790736379.165412:0:15100:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1790736379.165431:0:15100:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff941634ed8000) 00000020:00000080:2.0:1790736379.165453:0:15100:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1790736379.165527:0:15100:0:(tgt_mount.c:153:server_get_mount()) get mount ffff941637ef8000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1790736379.165532:0:15100:0:(tgt_mount.c:187:server_put_mount()) put mount ffff941637ef8000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1790736379.165535:0:15100:0:(obd_mount.c:710:lustre_put_lsi()) put ffff941637ef8000 3 00010000:00080000:2.0:1790736379.165572:0:15100:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94163faf1800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.105@tcp at head 00010000:00010000:2.0:1790736379.167677:0:15100:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1790736379.167883:0:15100:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1790736379.167918:0:15100:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790736379.167930:0:15100:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x6aae200528fe737e 00000100:00080000:2.0:1790736379.167940:0:15100:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790736379.167950:0:15100:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff94163faf1800 using connection 192.168.203.105@tcp/0@lo 00000100:00100000:2.0:1790736379.167983:0:15100:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94162f265880 x1877722816148480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790736379.168026:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1877722816148480:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790736379.170543:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736379.170675:0:14397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816148480 00000100:00100000:2.0:1790736379.170686:0:14397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816148480 00000100:00100000:2.0:1790736379.170747:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790736379.170756:0:14397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3305:x1877722816148480:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1790736379.170786:0:14397:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 451 last 0 00000020:00000080:2.0:1790736379.170825:0:14397:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x6aae200528fe7385 00000004:00100000:2.0:1790736379.170841:0:14397:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790736379.171123:0:14397:0:(import.c:65:import_set_state_nolock()) ffff941637f64000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790736379.171201:0:14397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877722816148480:12345-0@lo:38:llog_process_th.0 Request processed in 445us (3108us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736379.171208:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1790736379.171230:0:15100:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790736379.171251:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790736379.171255:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790736379.171257:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790736379.171265:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790736379.171316:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877722816148608:0@lo:400:kworker.0 00000100:00100000:2.0:1790736379.171347:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736379.171416:0:14398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816148608 00000100:00100000:2.0:1790736379.171421:0:14398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816148608 00000100:00100000:2.0:1790736379.171447:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790736379.171454:0:14398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877722816148608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736379.171493:0:14398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877722816148608:12345-0@lo:400:kworker.0 Request processed in 39us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736379.171499:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790736379.171530:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94162f266d80 x1877722816148608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790736395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790736379.171542:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877722816148608:0@lo:400:kworker.0 00010000:00080000:3.0:1790736379.171719:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94162f265880 x1877722816148480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790736389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736379.171739:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790736379.171745:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1790736379.171752:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1790736379.171756:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790736379.171759:0:3305:0:(import.c:65:import_set_state_nolock()) ffff94163faf1800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790736379.171764:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1877722816148480:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1790736379.172005:0:15100:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1790736379.172124:0:15077:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1790736379.172146:0:15077:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790736379.172159:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94163c527c00/0x6aae200528fe7369 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe7370 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736379.172170:0:15077:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff94163c527c00/0x6aae200528fe7369 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe7370 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790736379.172205:0:15077:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790736379.172207:0:15077:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790736379.172208:0:15077:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790736379.172210:0:15077:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790736379.172211:0:15077:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790736379.172212:0:15077:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790736379.172217:0:15077:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790736379.172219:0:15077:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790736379.172220:0:15077:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790736379.172223:0:15077:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1790736379.172226:0:15077:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790736379.172227:0:15077:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790736379.172228:0:15077:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790736379.172228:0:15077:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790736379.172229:0:15077:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790736379.172230:0:15077:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790736379.172231:0:15077:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790736379.172232:0:15077:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790736379.172233:0:15077:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790736379.172247:0:15077:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790736379.172257:0:15077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f266d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15077:1877722816148736:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790736379.172293:0:15077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736379.172318:0:15077:0:(client.c:2716:ptlrpc_set_wait()) set ffff941612fd10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790736379.172332:0:14391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816148736 00000100:00100000:2.0:1790736379.172336:0:14391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816148736 00000100:00100000:2.0:1790736379.172362:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790736379.172368:0:14391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635c1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+16:15077:x1877722816148736:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790736379.172602:0:14391:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1790736379.172617:0:14391:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1790736379.231377:0:14391:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790736379.231396:0:14391:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1790736379.231778:0:14412:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790736379.231784:0:14412:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790736379.231805:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9416013ffc00/0x6aae200528fe738c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736379.231824:0:14412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff941642173200/0x6aae200528fe72f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe72f2 expref: 16 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736379.231833:0:14412:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9416013ffc00/0x6aae200528fe738c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736379.231873:0:14412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff941642173200/0x6aae200528fe72f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6aae200528fe72f2 expref: 16 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736379.231889:0:14412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff941642173200/0x6aae200528fe72f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6aae200528fe72f2 expref: 16 pid: 14391 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736379.231915:0:14412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae2a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14412:1877722816148864:0@lo:104: 00000100:00100000:0.0:1790736379.231979:0:14412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736379.232033:0:14412:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611ce9540 going to sleep for 11 seconds 00000100:00100000:3.0:1790736379.232056:0:14380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816148864 00000100:00100000:3.0:1790736379.232064:0:14380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816148864 00000100:00100000:3.0:1790736379.232136:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790736379.232146:0:14380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+3:14412:x1877722816148864:12345-0@lo:104: 00010000:00010000:3.0:1790736379.232158:0:14380:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff941642173c00/0x6aae200528fe72f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe72f9 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736379.232214:0:14380:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790736379.232220:0:14380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+3:14412:x1877722816148864:12345-0@lo:104: Request processed in 77us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736379.232242:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1790736379.232267:0:14385:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790736379.232273:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff941642173c00/0x6aae200528fe72f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe72f9 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736379.232281:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642173c00 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:3.0:1790736379.232285:0:14385:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff941642173c00/0x6aae200528fe72f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6aae200528fe72f9 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736379.232294:0:14385:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff941642173c00/0x6aae200528fe72f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6aae200528fe72f9 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790736379.232301:0:14385:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff941642173c00/0x6aae200528fe72f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6aae200528fe72f9 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790736379.232307:0:14385:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790736379.232334:0:14385:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff941642173c00/0x6aae200528fe72f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe72f9 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736379.232341:0:14385:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790736379.232360:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff941642173c00/0x6aae200528fe72f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe72f9 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736379.232368:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff941642173c00/0x6aae200528fe72f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe72f9 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736379.232383:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736379.232385:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736379.232386:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736379.232407:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633801500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd61a3fa-9892-475c-9015-fd1ddc473c5e:3306:1877722816148992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790736379.232439:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736379.232678:0:14383:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816148992 00000100:00100000:3.0:1790736379.232683:0:14383:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816148992 00010000:00010000:3.0:1790736379.232699:0:14383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff941642173200/0x6aae200528fe72f9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe72f2 expref: 17 pid: 14391 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736379.232736:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790736379.232743:0:14383:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633801c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+17:3306:x1877722816148992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790736379.232753:0:14383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790736379.232759:0:14383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff941642173200/0x6aae200528fe72f9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe72f2 expref: 17 pid: 14391 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736379.232769:0:14383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff941642173200/0x6aae200528fe72f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6aae200528fe72f2 expref: 17 pid: 14391 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736379.232784:0:14383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9416013ffc00/0x6aae200528fe738c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736379.232792:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9416013ffc00/0x6aae200528fe738c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790736379.232807:0:14383:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002496010s 00010000:00010000:3.0:1790736379.232811:0:14383:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9416013ffc00/0x6aae200528fe738c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736379.232818:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9416013ffc00/0x6aae200528fe738c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736379.232826:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9416013ffc00/0x6aae200528fe738c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736379.232843:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9416013ffc00/0x6aae200528fe738c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736379.232849:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9416013ffc00 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:3.0:1790736379.232853:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9416013ffc00/0x6aae200528fe738c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736379.232861:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9416013ffc00/0x6aae200528fe738c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736379.232870:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9416013ffc00/0x6aae200528fe738c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736379.232880:0:14383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790736379.232912:0:14383:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633801c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+17:3306:x1877722816148992:12345-0@lo:103:ldlm_bl.0 Request processed in 169us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736379.232919:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790736379.232957:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633801500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd61a3fa-9892-475c-9015-fd1ddc473c5e:3306:1877722816148992:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790736379.232985:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941642173200/0x6aae200528fe72f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6aae200528fe72f2 expref: 16 pid: 14391 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736379.232996:0:14412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae2a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14412:1877722816148864:0@lo:104: 00010000:00010000:3.0:1790736379.233008:0:14412:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9416013ffc00/0x6aae200528fe738c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736379.233018:0:14412:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9416013ffc00/0x6aae200528fe738c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736379.233034:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9416013ffc00/0x6aae200528fe738c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736379.233041:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9416013ffc00/0x6aae200528fe738c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736379.245837:0:14391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635c1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+15:15077:x1877722816148736:12345-0@lo:253:mount.lustre.0 Request processed in 73460us (73535us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736379.245852:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790736379.245936:0:15077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f266d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15077:1877722816148736:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790736379.245952:0:15077:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1790736379.245955:0:15077:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790736379.245957:0:15077:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790736379.245958:0:15077:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790736379.245959:0:15077:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790736379.245960:0:15077:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790736379.245962:0:15077:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790736379.245963:0:15077:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790736379.245965:0:15077:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790736379.245966:0:15077:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1790736379.245982:0:15077:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1790736379.250809:0:15077:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1790736379.250989:0:15077:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1790736379.251327:0:15077:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1790736379.251564:0:15077:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1790736379.252062:0:15077:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1790736379.252304:0:15077:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1790736379.253248:0:15077:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1790736379.310687:0:15077:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1790736379.310695:0:15077:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1790736379.310740:0:15077:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790736379.310794:0:15077:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.105@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790736379.310808:0:15077:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1790736379.310849:0:15077:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1790736379.989933:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790736380.693231:0:14393:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790736380.693238:0:14393:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94163af23800 from 7 10000000:01000000:3.0:1790736380.693244:0:14393:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790736380.693295:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c8800/0x6aae200528fe7393 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736380.693308:0:14393:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff94162f8c8800/0x6aae200528fe7393 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736380.693319:0:14393:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff94162f8c8800/0x6aae200528fe7393 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736380.693347:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633801500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14393:1877722816149120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790736380.693419:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736380.693487:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162f5576c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790736380.693584:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816149120 00000100:00100000:2.0:1790736380.693593:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816149120 00000100:00100000:2.0:1790736380.693649:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790736380.693660:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941603fb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+15:14393:x1877722816149120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790736380.693673:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736380.693698:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94163c526a00/0x6aae200528fe739a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe7393 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736380.693740:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94163c526a00/0x6aae200528fe739a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe7393 expref: 16 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736380.693750:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94163c526a00/0x6aae200528fe739a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe7393 expref: 16 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736380.693759:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94163c526a00, rc 0) 00000100:00100000:2.0:1790736380.693815:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941603fb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+16:14393:x1877722816149120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736380.693821:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790736380.694042:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633801500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14393:1877722816149120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790736380.694059:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff94162f8c8800/0x6aae200528fe7393 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe739a expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736380.694080:0:14393:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff94162f8c8800/0x6aae200528fe7393 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe739a expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736380.694171:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14393:1877722816149248:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790736380.694201:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736380.694233:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611ce9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790736380.694332:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816149248 00000100:00100000:3.0:1790736380.694337:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816149248 00000100:00100000:3.0:1790736380.694372:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790736380.694380:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941603fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+16:14393:x1877722816149248:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1790736380.694396:0:14390:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790736380.694416:0:14390:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790736380.694419:0:14390:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1790736380.694507:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941603fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+16:14393:x1877722816149248:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 128us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736380.694514:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790736380.694598:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14393:1877722816149248:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790736380.694655:0:14393:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790736380.694662:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c8800/0x6aae200528fe7393 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe739a expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736380.694670:0:14393:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff94162f8c8800/0x6aae200528fe7393 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe739a expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736381.014468:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736382.038294:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736383.064835:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736384.092749:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790736384.667577:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:1.0:1790736384.667696:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633801180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd61a3fa-9892-475c-9015-fd1ddc473c5e:3307:1877722816149376:0@lo:400:kworker.0 00000100:00100000:1.0:1790736384.667768:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790736384.667871:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790736384.667888:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790736384.667891:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790736384.667941:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816149376 00000100:00100000:3.0:1790736384.667949:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816149376 00000100:00100000:3.0:1790736384.667997:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790736384.668006:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941603fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+16:3307:x1877722816149376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736384.668067:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941603fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+16:3307:x1877722816149376:12345-0@lo:400:kworker.0 Request processed in 61us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736384.668076:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790736384.668278:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633801f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877722816149504:0@lo:400:kworker.0 00000100:00100000:2.0:1790736384.668315:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736384.668360:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790736384.668366:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633802300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1877722816149632:0@lo:400:kworker.0 00000100:00100000:2.0:1790736384.668389:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736384.668420:0:14398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816149504 00000100:00100000:2.0:1790736384.668424:0:14398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816149504 00000100:00100000:2.0:1790736384.668451:0:14398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816149632 00000100:00100000:2.0:1790736384.668454:0:14398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816149632 00000100:00100000:3.0:1790736384.668514:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790736384.668522:0:14396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877722816149504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736384.668562:0:14396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877722816149504:12345-0@lo:400:kworker.0 Request processed in 41us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736384.668568:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790736384.674533:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633801180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd61a3fa-9892-475c-9015-fd1ddc473c5e:3307:1877722816149376:0@lo:400:kworker.0 00000100:00100000:2.0:1790736384.676506:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790736384.676524:0:14398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877722816149632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736384.676713:0:14398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877722816149632:12345-0@lo:400:kworker.0 Request processed in 195us (8322us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736384.676721:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1790736384.676780:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff941633802300 x1877722816149632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790736400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790736384.676905:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790736384.677042:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633802300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1877722816149632:0@lo:400:kworker.0 00010000:00080000:2.0:1790736384.677061:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff941633801f80 x1877722816149504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790736400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790736384.677070:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633801f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877722816149504:0@lo:400:kworker.0 00010000:00010000:0.0:1790736385.113781:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736386.136012:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790736386.273657:0:15445:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg305-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790736387.160559:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790736387.672778:0:14427:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790736388.182031:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736389.206161:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790736389.789170:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790736389.789177:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790736389.789180:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790736389.789183:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790736389.789247:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941642040a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd61a3fa-9892-475c-9015-fd1ddc473c5e:3306:1877722816149760:0@lo:400:kworker.0 00000100:00100000:1.0:1790736389.789314:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736389.789362:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790736389.789367:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941642042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877722816149888:0@lo:400:kworker.0 00000100:00100000:1.0:1790736389.789406:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736389.789434:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941642043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1877722816150016:0@lo:400:kworker.0 00000100:00100000:1.0:1790736389.789458:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736389.789515:0:14391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816149760 00000100:00100000:1.0:1790736389.789523:0:14391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816149760 00000100:00100000:1.0:1790736389.789561:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790736389.789568:0:14391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941603fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+16:3306:x1877722816149760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736389.789618:0:14391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941603fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+16:3306:x1877722816149760:12345-0@lo:400:kworker.0 Request processed in 49us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736389.789625:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790736389.789664:0:14398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816149888 00000100:00100000:1.0:1790736389.789668:0:14398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816149888 00000100:00100000:1.0:1790736389.789692:0:14398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816150016 00000100:00100000:1.0:1790736389.789694:0:14398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816150016 00000100:00100000:1.0:1790736389.789717:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790736389.789723:0:14398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642041c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877722816149888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736389.789754:0:14398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642041c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877722816149888:12345-0@lo:400:kworker.0 Request processed in 31us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736389.789760:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790736389.789771:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790736389.789777:0:14398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877722816150016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736389.789805:0:14398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877722816150016:12345-0@lo:400:kworker.0 Request processed in 28us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736389.789810:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1790736389.790025:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff941642042680 x1877722816149888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790736405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736389.790053:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941642042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877722816149888:0@lo:400:kworker.0 00000100:00100000:1.0:1790736389.790065:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941642040a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd61a3fa-9892-475c-9015-fd1ddc473c5e:3306:1877722816149760:0@lo:400:kworker.0 00000100:00080000:1.0:1790736389.790089:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790736389.790128:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff941642043100 x1877722816150016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790736405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736389.790137:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941642043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1877722816150016:0@lo:400:kworker.0 00010000:00010000:1.0:1790736390.229457:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790736390.421510:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790736375/real 1790736375] req@ffff94162f265180 x1877722816145920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790736390 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790736390.421544:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94162f265180 x1877722816145920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790736390 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790736390.421555:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790736375/real 1790736375] req@ffff94162f265500 x1877722816146048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790736390 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790736390.421574:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94162f265500 x1877722816146048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790736390 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790736390.421595:0:3305:0:(import.c:65:import_set_state_nolock()) ffff941606685800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790736390.421633:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790736390.421638:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1877722816145920:0@lo:8:kworker.0 00000100:00080000:0.0:1790736390.421652:0:3305:0:(import.c:65:import_set_state_nolock()) ffff94161196b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790736390.421676:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790736390.421679:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1877722816146048:0@lo:8:kworker.0 00000100:00080000:1.0:1790736390.421913:0:12664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790736390.421918:0:12664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1790736390.421921:0:12664:0:(import.c:65:import_set_state_nolock()) ffff941606685800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790736390.421926:0:12664:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 447 00000100:00080000:1.0:1790736390.421931:0:12664:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1790736390.421941:0:12664:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff941606685800 using connection 192.168.203.105@tcp/0@lo 00000100:00100000:1.0:1790736390.421961:0:12664:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff941642040a80 x1877722816150272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790736390.421978:0:12664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790736390.421981:0:12664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1790736390.421983:0:12664:0:(import.c:65:import_set_state_nolock()) ffff94161196b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790736390.421986:0:12664:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 447 00000100:00080000:1.0:1790736390.421988:0:12664:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1790736390.421992:0:12664:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff94161196b800 using connection 192.168.203.105@tcp/0@lo 00000100:00100000:1.0:1790736390.422002:0:12664:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff941642042680 x1877722816150400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790736390.422065:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941642042a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877722816150528:0@lo:400:kworker.0 00000100:00100000:1.0:1790736390.422148:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736390.422206:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790736390.422212:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941642040380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1877722816150656:0@lo:400:kworker.0 00000100:00100000:1.0:1790736390.422233:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736390.422271:0:14398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816150528 00000100:00100000:1.0:1790736390.422279:0:14398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816150528 00000100:00100000:1.0:1790736390.422316:0:14398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816150656 00000100:00100000:1.0:1790736390.422319:0:14398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816150656 00000100:00100000:1.0:1790736390.422335:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790736390.422343:0:14398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877722816150528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736390.422393:0:14398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877722816150528:12345-0@lo:400:kworker.0 Request processed in 50us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736390.422400:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790736390.422415:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790736390.422421:0:14398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877722816150656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736390.422445:0:14398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877722816150656:12345-0@lo:400:kworker.0 Request processed in 24us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736390.422451:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1790736390.422483:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff941642040380 x1877722816150656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790736406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736390.422496:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941642040380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1877722816150656:0@lo:400:kworker.0 00010000:00080000:1.0:1790736390.422505:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff941642042a00 x1877722816150528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790736406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736390.422513:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941642042a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877722816150528:0@lo:400:kworker.0 00000100:00100000:3.0:1790736390.422613:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790736390.422624:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941642043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd61a3fa-9892-475c-9015-fd1ddc473c5e:3308:1877722816150144:0@lo:400:kworker.0 00000100:00100000:3.0:1790736390.422667:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736390.422899:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941642040a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1877722816150272:0@lo:8:kworker.0 00000100:00100000:0.0:1790736390.422937:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736390.423006:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941642042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1877722816150400:0@lo:8:kworker.0 00000100:00100000:0.0:1790736390.423031:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736390.423074:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816150144 00000100:00100000:1.0:1790736390.423079:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816150144 00000100:00100000:1.0:1790736390.423133:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790736390.423140:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941603fba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+16:3308:x1877722816150144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736390.423181:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941603fba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+16:3308:x1877722816150144:12345-0@lo:400:kworker.0 Request processed in 41us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736390.423187:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790736390.423826:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941642043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd61a3fa-9892-475c-9015-fd1ddc473c5e:3308:1877722816150144:0@lo:400:kworker.0 00000100:00100000:3.0:1790736390.433424:0:15078:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816150272 00000100:00100000:3.0:1790736390.433442:0:15078:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816150272 00000100:00100000:3.0:1790736390.433564:0:15078:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816150400 00000100:00100000:3.0:1790736390.433568:0:15078:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816150400 00000100:00100000:2.0:1790736390.433652:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790736390.433662:0:15079:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1877722816150272:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1790736390.433695:0:15079:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 462 last 0 00000020:00000080:2.0:1790736390.433725:0:15079:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6aae200528fe73a1 00002000:00100000:2.0:1790736390.433741:0:15079:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff941637f67000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1790736390.433745:0:15079:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1790736390.433748:0:15079:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790736390.434123:0:15079:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790736390.434150:0:15079:0:(import.c:65:import_set_state_nolock()) ffff941637f66000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790736390.434231:0:15079:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1877722816150272:12345-0@lo:8:kworker.0 Request processed in 568us (11292us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736390.434239:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790736390.434261:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790736390.434266:0:15079:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1877722816150400:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1790736390.434277:0:15079:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790736390.434301:0:15079:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1877722816150400:12345-0@lo:8:kworker.0 Request processed in 34us (11269us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790736390.434322:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790736390.434509:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff941642040a80 x1877722816150272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790736410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790736390.434520:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790736390.434527:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1790736390.434534:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790736390.434539:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1790736390.434541:0:3305:0:(import.c:65:import_set_state_nolock()) ffff941606685800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1790736390.434554:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790736390.434559:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941642040a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1877722816150272:0@lo:8:kworker.0 00000100:00080000:0.0:1790736390.434572:0:3305:0:(import.c:65:import_set_state_nolock()) ffff94161196b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790736390.434576:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790736390.434579:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941642042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1877722816150400:0@lo:8:kworker.0 00000004:00080000:0.0:1790736390.434652:0:14419:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:0.0:1790736390.434672:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14419:1877722816150912:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1790736390.434706:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736390.458761:0:15081:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816150912 00000100:00100000:1.0:1790736390.458778:0:15081:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816150912 00000100:00100000:0.0:1790736390.458830:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff94161871a780 going to sleep for 11 seconds 00000100:00080000:1.0:1790736390.458831:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790736390.458896:0:15081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790736390.458907:0:15081:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14419:x1877722816150912:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1790736390.472225:0:14418:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1790736390.475225:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790736390.475302:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816150784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790736390.475410:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736390.475508:0:15082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816150784 00000100:00100000:0.0:1790736390.475517:0:15082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816150784 00000100:00100000:0.0:1790736390.475564:0:15082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790736390.475575:0:15082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1877722816150784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790736390.475633:0:15082:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790736390.475697:0:15082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1877722816150784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736390.475703:0:15082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1790736390.475741:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94163fae3b80 x1877722816150784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790736390.475761:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816150784:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1790736390.479737:0:14418:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 462490639217ns, next at 0ns, rc = 0 00002000:00080000:1.0:1790736390.483241:0:15081:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1790736390.483253:0:15081:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1790736390.483260:0:15081:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:1.0:1790736390.508652:0:15081:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790736390.508666:0:15081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acef8c20/0x6aae200528fe73a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736390.508683:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=462s v=(0 0) 00010000:00010000:1.0:1790736390.508687:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790736390.508693:0:15081:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acef8c20/0x6aae200528fe73a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736390.508710:0:15081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acef8c20/0x6aae200528fe73a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736390.508732:0:15081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acef8c20/0x6aae200528fe73a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736390.508740:0:15081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acef8c20/0x6aae200528fe73a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736390.508772:0:15081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790736390.509838:0:14385:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790736390.509848:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acef8c20/0x6aae200528fe73a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.509866:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c61800 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:0.0:1790736390.509871:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acef8c20/0x6aae200528fe73a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.509881:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acef8c20/0x6aae200528fe73a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.509922:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acef8c20/0x6aae200528fe73a8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.509946:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acef8c20/0x6aae200528fe73a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.509970:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736390.509972:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736390.509974:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790736390.510813:0:15081:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790736390.510823:0:15081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066ec03d8/0x6aae200528fe73af lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.510834:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1790736390.510840:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736390.510846:0:15081:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066ec03d8/0x6aae200528fe73af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.510859:0:15081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066ec03d8/0x6aae200528fe73af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.510870:0:15081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066ec03d8/0x6aae200528fe73af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.510881:0:15081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066ec03d8/0x6aae200528fe73af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.510909:0:15081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790736390.511251:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790736390.511258:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066ec03d8/0x6aae200528fe73af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736390.511660:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9416013fe200 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:1.0:1790736390.511667:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066ec03d8/0x6aae200528fe73af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736390.511681:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066ec03d8/0x6aae200528fe73af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736390.511696:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066ec03d8/0x6aae200528fe73af lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790736390.511792:0:15081:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790736390.511815:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066ec03d8/0x6aae200528fe73af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736390.512246:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736390.512257:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736390.512259:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736390.512329:0:15081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d9eb69e/0x6aae200528fe73b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.512344:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1790736390.512349:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736390.512355:0:15081:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d9eb69e/0x6aae200528fe73b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.512372:0:15081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d9eb69e/0x6aae200528fe73b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.512381:0:15081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d9eb69e/0x6aae200528fe73b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.512395:0:15081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d9eb69e/0x6aae200528fe73b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.512424:0:15081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790736390.513731:0:14385:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790736390.513739:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d9eb69e/0x6aae200528fe73b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736390.513751:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9416013fe400 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:1.0:1790736390.513756:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d9eb69e/0x6aae200528fe73b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736390.513766:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d9eb69e/0x6aae200528fe73b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736390.513783:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d9eb69e/0x6aae200528fe73b6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736390.513791:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d9eb69e/0x6aae200528fe73b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736390.513810:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736390.513812:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736390.513813:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790736390.513850:0:15081:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790736390.513857:0:15081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000222980e2/0x6aae200528fe73bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.513867:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1790736390.513871:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736390.513877:0:15081:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000222980e2/0x6aae200528fe73bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.513950:0:15081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000222980e2/0x6aae200528fe73bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.513967:0:15081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000222980e2/0x6aae200528fe73bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.513975:0:15081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000222980e2/0x6aae200528fe73bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.513995:0:15081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790736390.514166:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790736390.514172:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000222980e2/0x6aae200528fe73bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736390.514180:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9416013ff800 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:1.0:1790736390.514183:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000222980e2/0x6aae200528fe73bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736390.514197:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000222980e2/0x6aae200528fe73bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736390.514208:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000222980e2/0x6aae200528fe73bd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736390.514216:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000222980e2/0x6aae200528fe73bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736390.514230:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736390.514232:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736390.514233:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790736390.515413:0:15081:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790736390.515423:0:15081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d0433f0/0x6aae200528fe73c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.515437:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1790736390.515440:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736390.515446:0:15081:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d0433f0/0x6aae200528fe73c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.515458:0:15081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d0433f0/0x6aae200528fe73c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.515467:0:15081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d0433f0/0x6aae200528fe73c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.515476:0:15081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d0433f0/0x6aae200528fe73c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.515511:0:15081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790736390.516066:0:14385:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790736390.516074:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d0433f0/0x6aae200528fe73c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.516083:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9416013ff400 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:2.0:1790736390.516087:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d0433f0/0x6aae200528fe73c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.516113:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d0433f0/0x6aae200528fe73c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.516131:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d0433f0/0x6aae200528fe73c4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.516139:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d0433f0/0x6aae200528fe73c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.516161:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736390.516163:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736390.516165:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790736390.516594:0:15081:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790736390.516601:0:15081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083374fc2/0x6aae200528fe73cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.516625:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1790736390.516630:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736390.516635:0:15081:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083374fc2/0x6aae200528fe73cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.516655:0:15081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083374fc2/0x6aae200528fe73cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.516664:0:15081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083374fc2/0x6aae200528fe73cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.516672:0:15081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083374fc2/0x6aae200528fe73cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.516695:0:15081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790736390.517135:0:15081:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790736390.517142:0:15081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003ba72e9/0x6aae200528fe73d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.517151:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1790736390.517159:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736390.517163:0:15081:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003ba72e9/0x6aae200528fe73d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.517178:0:15081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003ba72e9/0x6aae200528fe73d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.517188:0:15081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003ba72e9/0x6aae200528fe73d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.517198:0:15081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003ba72e9/0x6aae200528fe73d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.517214:0:15081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790736390.517603:0:14385:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790736390.517612:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083374fc2/0x6aae200528fe73cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736390.517705:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9416013ffc00 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:1.0:1790736390.517711:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083374fc2/0x6aae200528fe73cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736390.517721:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083374fc2/0x6aae200528fe73cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790736390.517728:0:15081:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790736390.517735:0:15081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5e2c05b/0x6aae200528fe73d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736390.517738:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083374fc2/0x6aae200528fe73cb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.517756:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1790736390.517763:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736390.517772:0:15081:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5e2c05b/0x6aae200528fe73d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736390.517774:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083374fc2/0x6aae200528fe73cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.517794:0:15081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5e2c05b/0x6aae200528fe73d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.517810:0:15081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5e2c05b/0x6aae200528fe73d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.517826:0:15081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5e2c05b/0x6aae200528fe73d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.517836:0:15081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790736390.517890:0:14385:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790736390.517895:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003ba72e9/0x6aae200528fe73d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736390.517902:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163be28a00 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:1.0:1790736390.517906:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003ba72e9/0x6aae200528fe73d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736390.517914:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003ba72e9/0x6aae200528fe73d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736390.517926:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003ba72e9/0x6aae200528fe73d2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736390.517932:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003ba72e9/0x6aae200528fe73d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.517944:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790736390.517947:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736390.517951:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736390.517953:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5e2c05b/0x6aae200528fe73d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736390.517954:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736390.517965:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163be28c00 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:2.0:1790736390.517969:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5e2c05b/0x6aae200528fe73d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.517999:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5e2c05b/0x6aae200528fe73d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.518013:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5e2c05b/0x6aae200528fe73d9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.518022:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5e2c05b/0x6aae200528fe73d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.518038:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736390.518040:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736390.518042:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790736390.518721:0:15081:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790736390.518728:0:15081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1e326c0/0x6aae200528fe73e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.518739:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1790736390.518742:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736390.518747:0:15081:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1e326c0/0x6aae200528fe73e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.518757:0:15081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1e326c0/0x6aae200528fe73e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.518765:0:15081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1e326c0/0x6aae200528fe73e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.518772:0:15081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1e326c0/0x6aae200528fe73e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.518836:0:15081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790736390.521025:0:15081:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790736390.521047:0:15081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085a96be0/0x6aae200528fe73e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.521068:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1790736390.521072:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736390.521078:0:15081:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085a96be0/0x6aae200528fe73e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.521090:0:15081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085a96be0/0x6aae200528fe73e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.521121:0:15081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085a96be0/0x6aae200528fe73e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.521128:0:15081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085a96be0/0x6aae200528fe73e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.523045:0:14385:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790736390.523057:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1e326c0/0x6aae200528fe73e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.523070:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163be29a00 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:2.0:1790736390.523074:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1e326c0/0x6aae200528fe73e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.523084:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1e326c0/0x6aae200528fe73e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.523117:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1e326c0/0x6aae200528fe73e0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.523141:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1e326c0/0x6aae200528fe73e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.523191:0:14385:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790736390.523196:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085a96be0/0x6aae200528fe73e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.523202:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163be28800 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:2.0:1790736390.523206:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085a96be0/0x6aae200528fe73e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.523214:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085a96be0/0x6aae200528fe73e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.523225:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085a96be0/0x6aae200528fe73e7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.523231:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736390.523233:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736390.523235:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736390.523368:0:15081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790736390.523376:0:15081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085a96be0/0x6aae200528fe73e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790736390.523941:0:15081:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790736390.523949:0:15081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095c6d4f5/0x6aae200528fe73ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.523961:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1790736390.523966:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736390.523972:0:15081:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095c6d4f5/0x6aae200528fe73ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.523994:0:15081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095c6d4f5/0x6aae200528fe73ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.524003:0:15081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095c6d4f5/0x6aae200528fe73ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.524011:0:15081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095c6d4f5/0x6aae200528fe73ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.524027:0:15081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790736390.524221:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790736390.524228:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095c6d4f5/0x6aae200528fe73ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.524236:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163be28600 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:2.0:1790736390.524246:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095c6d4f5/0x6aae200528fe73ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.524254:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095c6d4f5/0x6aae200528fe73ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.524267:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095c6d4f5/0x6aae200528fe73ee lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.524275:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095c6d4f5/0x6aae200528fe73ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.524292:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736390.524294:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736390.524295:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736390.524301:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790736390.525012:0:15081:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790736390.525019:0:15081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dffcab1b/0x6aae200528fe73f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.525030:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1790736390.525043:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736390.525049:0:15081:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dffcab1b/0x6aae200528fe73f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.525057:0:15081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dffcab1b/0x6aae200528fe73f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.525065:0:15081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dffcab1b/0x6aae200528fe73f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.525082:0:15081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dffcab1b/0x6aae200528fe73f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.525144:0:15081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790736390.525571:0:15081:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790736390.525577:0:15081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b45a26d/0x6aae200528fe73fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.525585:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1790736390.525588:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736390.525592:0:15081:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b45a26d/0x6aae200528fe73fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.525601:0:15081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b45a26d/0x6aae200528fe73fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.525609:0:15081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b45a26d/0x6aae200528fe73fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.525616:0:15081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b45a26d/0x6aae200528fe73fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.525629:0:15081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790736390.526193:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790736390.526201:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dffcab1b/0x6aae200528fe73f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.526210:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163be28000 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:2.0:1790736390.526215:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dffcab1b/0x6aae200528fe73f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.526223:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dffcab1b/0x6aae200528fe73f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.526239:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dffcab1b/0x6aae200528fe73f5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.526255:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dffcab1b/0x6aae200528fe73f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.526277:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790736390.526280:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b45a26d/0x6aae200528fe73fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.526286:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163be28e00 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:2.0:1790736390.526289:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b45a26d/0x6aae200528fe73fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.526296:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b45a26d/0x6aae200528fe73fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.526306:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b45a26d/0x6aae200528fe73fc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.526313:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b45a26d/0x6aae200528fe73fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.526324:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736390.526326:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736390.526328:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736390.526334:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790736390.526629:0:15081:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790736390.526636:0:15081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea17227c/0x6aae200528fe7403 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.526660:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1790736390.526663:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736390.526668:0:15081:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea17227c/0x6aae200528fe7403 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.526677:0:15081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea17227c/0x6aae200528fe7403 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.526686:0:15081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea17227c/0x6aae200528fe7403 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.526694:0:15081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea17227c/0x6aae200528fe7403 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.526848:0:15081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790736390.527448:0:15081:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790736390.527455:0:15081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006eaf8a1c/0x6aae200528fe740a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.527466:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1790736390.527469:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736390.527473:0:15081:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006eaf8a1c/0x6aae200528fe740a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.527481:0:15081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006eaf8a1c/0x6aae200528fe740a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.527654:0:15081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006eaf8a1c/0x6aae200528fe740a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.527661:0:15081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006eaf8a1c/0x6aae200528fe740a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.529392:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790736390.529404:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea17227c/0x6aae200528fe7403 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.529426:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163be29800 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:2.0:1790736390.529430:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea17227c/0x6aae200528fe7403 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.529439:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea17227c/0x6aae200528fe7403 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.529459:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea17227c/0x6aae200528fe7403 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.529467:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea17227c/0x6aae200528fe7403 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736390.529590:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790736390.529596:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006eaf8a1c/0x6aae200528fe740a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736390.529613:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163be28200 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:3.0:1790736390.529616:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006eaf8a1c/0x6aae200528fe740a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736390.529623:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006eaf8a1c/0x6aae200528fe740a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736390.529637:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006eaf8a1c/0x6aae200528fe740a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736390.529656:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736390.529657:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736390.529659:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736390.530317:0:15081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790736390.530327:0:15081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006eaf8a1c/0x6aae200528fe740a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790736390.536337:0:15081:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790736390.536351:0:15081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085a96be0/0x6aae200528fe7411 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.536368:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1790736390.536372:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736390.536378:0:15081:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085a96be0/0x6aae200528fe7411 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.536393:0:15081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085a96be0/0x6aae200528fe7411 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.536401:0:15081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085a96be0/0x6aae200528fe7411 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.536422:0:15081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085a96be0/0x6aae200528fe7411 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.537257:0:14385:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790736390.537268:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085a96be0/0x6aae200528fe7411 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.537278:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163be28800 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:2.0:1790736390.537282:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085a96be0/0x6aae200528fe7411 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.537291:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085a96be0/0x6aae200528fe7411 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.537309:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085a96be0/0x6aae200528fe7411 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.537482:0:15081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790736390.537489:0:15081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085a96be0/0x6aae200528fe7411 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.538996:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736390.539138:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736390.539141:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736390.539144:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790736390.540683:0:15081:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790736390.540694:0:15081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000854d4ea0/0x6aae200528fe7418 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.540711:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1790736390.540715:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736390.540721:0:15081:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000854d4ea0/0x6aae200528fe7418 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.540734:0:15081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000854d4ea0/0x6aae200528fe7418 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.540743:0:15081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000854d4ea0/0x6aae200528fe7418 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.540751:0:15081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000854d4ea0/0x6aae200528fe7418 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.540776:0:15081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790736390.541537:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790736390.541546:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000854d4ea0/0x6aae200528fe7418 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736390.541556:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163be28400 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:3.0:1790736390.541561:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000854d4ea0/0x6aae200528fe7418 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736390.541570:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000854d4ea0/0x6aae200528fe7418 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736390.541587:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000854d4ea0/0x6aae200528fe7418 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736390.541601:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000854d4ea0/0x6aae200528fe7418 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736390.541625:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736390.541627:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736390.541629:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790736390.544962:0:15081:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790736390.544976:0:15081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006eaf8a1c/0x6aae200528fe741f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.544994:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1790736390.544998:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736390.545003:0:15081:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006eaf8a1c/0x6aae200528fe741f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.545017:0:15081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006eaf8a1c/0x6aae200528fe741f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.545028:0:15081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006eaf8a1c/0x6aae200528fe741f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.545045:0:15081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006eaf8a1c/0x6aae200528fe741f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.545065:0:15081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790736390.545633:0:14385:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790736390.545651:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006eaf8a1c/0x6aae200528fe741f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736390.545660:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163be28200 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:3.0:1790736390.545664:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006eaf8a1c/0x6aae200528fe741f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736390.545673:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006eaf8a1c/0x6aae200528fe741f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736390.545689:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006eaf8a1c/0x6aae200528fe741f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736390.545697:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006eaf8a1c/0x6aae200528fe741f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736390.545716:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736390.545718:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736390.545720:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790736390.546448:0:15081:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790736390.546457:0:15081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074c56173/0x6aae200528fe7426 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.546469:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1790736390.546482:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736390.546487:0:15081:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074c56173/0x6aae200528fe7426 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.546562:0:15081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074c56173/0x6aae200528fe7426 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.546572:0:15081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074c56173/0x6aae200528fe7426 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.546579:0:15081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074c56173/0x6aae200528fe7426 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.546689:0:15081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790736390.547367:0:15081:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790736390.547374:0:15081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c3d9bba/0x6aae200528fe742d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.547385:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1790736390.547388:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736390.547393:0:15081:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c3d9bba/0x6aae200528fe742d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.547403:0:15081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c3d9bba/0x6aae200528fe742d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.547411:0:15081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c3d9bba/0x6aae200528fe742d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.547424:0:15081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c3d9bba/0x6aae200528fe742d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736390.548263:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790736390.548271:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074c56173/0x6aae200528fe7426 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736390.548279:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163be29600 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:3.0:1790736390.548283:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074c56173/0x6aae200528fe7426 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736390.548292:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074c56173/0x6aae200528fe7426 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736390.548310:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074c56173/0x6aae200528fe7426 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736390.548319:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074c56173/0x6aae200528fe7426 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736390.548362:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790736390.548366:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c3d9bba/0x6aae200528fe742d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736390.548373:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163be29400 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:3.0:1790736390.548376:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c3d9bba/0x6aae200528fe742d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736390.548383:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c3d9bba/0x6aae200528fe742d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736390.548406:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c3d9bba/0x6aae200528fe742d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736390.548414:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736390.548416:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736390.548418:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736390.548467:0:15081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790736390.548473:0:15081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c3d9bba/0x6aae200528fe742d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790736390.550682:0:15081:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790736390.550693:0:15081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a50c1a97/0x6aae200528fe7434 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.550708:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1790736390.550713:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736390.550718:0:15081:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a50c1a97/0x6aae200528fe7434 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.550732:0:15081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a50c1a97/0x6aae200528fe7434 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.550741:0:15081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a50c1a97/0x6aae200528fe7434 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.550749:0:15081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a50c1a97/0x6aae200528fe7434 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.550774:0:15081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790736390.551408:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790736390.551416:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a50c1a97/0x6aae200528fe7434 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.551425:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163be29000 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:2.0:1790736390.551429:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a50c1a97/0x6aae200528fe7434 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.551439:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a50c1a97/0x6aae200528fe7434 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.551455:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a50c1a97/0x6aae200528fe7434 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.551463:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a50c1a97/0x6aae200528fe7434 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.551482:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736390.551484:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736390.551485:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736390.551930:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790736390.552076:0:15081:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790736390.552083:0:15081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023e141d7/0x6aae200528fe743b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.552286:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1790736390.552290:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736390.552296:0:15081:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023e141d7/0x6aae200528fe743b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.552308:0:15081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023e141d7/0x6aae200528fe743b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.552317:0:15081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023e141d7/0x6aae200528fe743b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.552325:0:15081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023e141d7/0x6aae200528fe743b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.552367:0:15081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790736390.552823:0:15081:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790736390.552829:0:15081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037a95876/0x6aae200528fe7442 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.552838:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1790736390.552847:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736390.552851:0:15081:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037a95876/0x6aae200528fe7442 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.552860:0:15081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037a95876/0x6aae200528fe7442 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.552868:0:15081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037a95876/0x6aae200528fe7442 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.552874:0:15081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037a95876/0x6aae200528fe7442 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.552953:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790736390.552964:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023e141d7/0x6aae200528fe743b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.552972:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163be29c00 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:2.0:1790736390.552975:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023e141d7/0x6aae200528fe743b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.552984:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023e141d7/0x6aae200528fe743b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.552997:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023e141d7/0x6aae200528fe743b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.553005:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023e141d7/0x6aae200528fe743b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.553212:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790736390.553217:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037a95876/0x6aae200528fe7442 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.553224:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163be29200 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:2.0:1790736390.553227:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037a95876/0x6aae200528fe7442 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.553235:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037a95876/0x6aae200528fe7442 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.553259:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037a95876/0x6aae200528fe7442 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.553268:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736390.553269:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736390.553272:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736390.553521:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736390.553861:0:15081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790736390.553868:0:15081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037a95876/0x6aae200528fe7442 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790736390.557844:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:0.0:1790736390.559815:0:15081:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790736390.559829:0:15081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085a96be0/0x6aae200528fe7449 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.559851:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1790736390.559856:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736390.559862:0:15081:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085a96be0/0x6aae200528fe7449 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.559877:0:15081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085a96be0/0x6aae200528fe7449 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.559977:0:15081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085a96be0/0x6aae200528fe7449 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.559986:0:15081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085a96be0/0x6aae200528fe7449 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.560214:0:15081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790736390.560835:0:15081:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790736390.560842:0:15081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037a95876/0x6aae200528fe7450 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.560854:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1790736390.560857:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736390.560862:0:15081:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037a95876/0x6aae200528fe7450 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.560872:0:15081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037a95876/0x6aae200528fe7450 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.560880:0:15081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037a95876/0x6aae200528fe7450 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.560965:0:15081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037a95876/0x6aae200528fe7450 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.561262:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790736390.561270:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085a96be0/0x6aae200528fe7449 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.561278:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163be28800 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:2.0:1790736390.561283:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085a96be0/0x6aae200528fe7449 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.561294:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085a96be0/0x6aae200528fe7449 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.561312:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085a96be0/0x6aae200528fe7449 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.561319:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085a96be0/0x6aae200528fe7449 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736390.561384:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790736390.561390:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037a95876/0x6aae200528fe7450 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736390.561397:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163be29200 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:3.0:1790736390.561400:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037a95876/0x6aae200528fe7450 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736390.561408:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037a95876/0x6aae200528fe7450 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736390.561418:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037a95876/0x6aae200528fe7450 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736390.561425:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736390.561427:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736390.561429:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736390.561516:0:15081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790736390.561521:0:15081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037a95876/0x6aae200528fe7450 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790736390.562283:0:15081:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790736390.562290:0:15081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c3d9bba/0x6aae200528fe7457 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.562302:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1790736390.562305:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736390.562310:0:15081:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c3d9bba/0x6aae200528fe7457 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.562320:0:15081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c3d9bba/0x6aae200528fe7457 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.562329:0:15081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c3d9bba/0x6aae200528fe7457 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.562337:0:15081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c3d9bba/0x6aae200528fe7457 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.562972:0:14385:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790736390.562988:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c3d9bba/0x6aae200528fe7457 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.562997:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163be29400 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:2.0:1790736390.563001:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c3d9bba/0x6aae200528fe7457 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.563011:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c3d9bba/0x6aae200528fe7457 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.563025:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c3d9bba/0x6aae200528fe7457 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.563314:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736390.563316:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736390.563319:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736390.563380:0:15081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790736390.563388:0:15081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c3d9bba/0x6aae200528fe7457 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736390.563557:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790736390.564493:0:15081:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790736390.564563:0:15081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000918ad74f/0x6aae200528fe745e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.564577:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1790736390.564647:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736390.564653:0:15081:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000918ad74f/0x6aae200528fe745e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.564667:0:15081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000918ad74f/0x6aae200528fe745e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.564677:0:15081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000918ad74f/0x6aae200528fe745e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.564685:0:15081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000918ad74f/0x6aae200528fe745e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736390.564745:0:15081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1790736390.564963:0:15081:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:0.0:1790736390.565261:0:15081:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14419:x1877722816150912:12345-0@lo:5:osp-pre-0-0.0 Request processed in 106352us (130550us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736390.565286:0:15081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1790736390.565666:0:14385:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790736390.565675:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000918ad74f/0x6aae200528fe745e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.565685:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163be29e00 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:2.0:1790736390.565688:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000918ad74f/0x6aae200528fe745e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.565698:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000918ad74f/0x6aae200528fe745e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.565715:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000918ad74f/0x6aae200528fe745e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.565731:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000918ad74f/0x6aae200528fe745e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736390.565753:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736390.565755:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736390.565757:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736390.565822:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14419:1877722816150912:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1790736390.565837:0:14419:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:1.0:1790736390.565939:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941642042a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14419:1877722816151040:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1790736390.565980:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736390.566070:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff941612fd19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790736390.566399:0:15078:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816151040 00000100:00100000:3.0:1790736390.566407:0:15078:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816151040 00000100:00100000:3.0:1790736390.566490:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790736390.566509:0:15078:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14419:x1877722816151040:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1790736390.566555:0:15078:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:1.0:1790736390.588353:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941642042a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14419:1877722816151040:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1790736390.588372:0:14419:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000100:00100000:0.0:1790736390.589000:0:15078:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14419:x1877722816151040:12345-0@lo:5:osp-pre-0-0.0 Request processed in 22499us (23014us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1790736390.589021:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1790736391.257732:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736392.281245:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736393.303495:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736394.326210:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790736394.443404:0:15795:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790736394.443407:0:15795:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1790736394.443534:0:15795:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9416064e9000 00000020:01000004:0.0:1790736394.443549:0:15795:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1790736394.443561:0:15795:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1790736394.443574:0:15795:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9416181e0000) 00000020:00000080:0.0:1790736394.443589:0:15795:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1790736394.489485:0:15795:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1790736394.490374:0:15795:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1790736394.492480:0:15795:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1790736394.493251:0:15795:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1790736394.493491:0:15795:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1790736394.495878:0:15795:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 239: rc = 0 00100000:10000000:3.0:1790736394.495976:0:15795:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 239: rc = 0 00100000:10000000:3.0:1790736394.496086:0:15795:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 239: rc = 0 00100000:10000000:1.0:1790736394.497921:0:15795:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 608: rc = 0 00100000:10000000:1.0:1790736394.498283:0:15795:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 608: rc = 0 00100000:10000000:1.0:1790736394.498988:0:15795:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 608: rc = 0 00100000:10000000:1.0:1790736394.499374:0:15795:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 608: rc = 0 00100000:10000000:1.0:1790736394.500425:0:15795:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 608: rc = 0 00100000:10000000:1.0:1790736394.500710:0:15795:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 608: rc = 0 00000020:00000080:1.0:1790736394.503781:0:15795:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1790736394.503794:0:15795:0:(osd_handler.c:1577:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790736394.503811:0:15795:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6aae200528fe746c 00000020:01000004:1.0:1790736394.503819:0:15795:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1790736394.503838:0:15795:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.105@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1790736394.503841:0:15795:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.105@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1790736394.503848:0:15795:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1790736394.503869:0:15795:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1790736394.503873:0:15795:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.105@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1790736394.518747:0:15795:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.105@tcp ctxt 0 is initialized 00000020:01000004:1.0:1790736394.518787:0:15795:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.105@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1790736394.518791:0:15795:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1790736394.518793:0:15795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790736394.518794:0:15795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790736394.518795:0:15795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790736394.518796:0:15795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790736394.518797:0:15795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790736394.518799:0:15795:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790736394.518805:0:15795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790736394.518806:0:15795:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790736394.518809:0:15795:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1790736394.518811:0:15795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790736394.518813:0:15795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790736394.518814:0:15795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790736394.518815:0:15795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790736394.518815:0:15795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790736394.518816:0:15795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790736394.518817:0:15795:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790736394.518818:0:15795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790736394.518819:0:15795:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790736394.518975:0:15795:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1790736394.519464:0:15795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941642040000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15795:1877722816151168:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790736394.519630:0:15795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736394.519687:0:15795:0:(client.c:2716:ptlrpc_set_wait()) set ffff941602e9b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790736394.519757:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816151168 00000100:00100000:3.0:1790736394.519764:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816151168 00000100:00100000:3.0:1790736394.519842:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790736394.519851:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941603fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+16:15795:x1877722816151168:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790736394.519886:0:14390:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1790736394.519889:0:14390:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1790736394.519893:0:14390:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1790736394.570915:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941603fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+16:15795:x1877722816151168:12345-0@lo:253:mount.lustre.0 Request processed in 51055us (51276us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736394.570930:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790736394.571269:0:15795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941642040000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15795:1877722816151168:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790736394.571286:0:15795:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1790736394.571289:0:15795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790736394.571291:0:15795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790736394.571292:0:15795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790736394.571294:0:15795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790736394.571295:0:15795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790736394.571296:0:15795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790736394.571298:0:15795:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790736394.571299:0:15795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790736394.571301:0:15795:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790736394.571323:0:15795:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9416064e9000 from lustre-OST0001 10000000:01000000:3.0:1790736394.571349:0:15795:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1790736394.571365:0:15795:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1790736394.571373:0:15795:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff94163400cd40 local copy 00010000:00010000:3.0:1790736394.571384:0:15795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c9c00/0x6aae200528fe7219 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe7220 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736394.571646:0:15795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633800a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15795:1877722816151296:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790736394.571685:0:15795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736394.571729:0:15795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416181e9900 going to sleep for 11 seconds 00000100:00100000:1.0:1790736394.571847:0:14391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816151296 00000100:00100000:1.0:1790736394.571861:0:14391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816151296 00000100:00100000:1.0:1790736394.571907:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790736394.571916:0:14391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941603fb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+16:15795:x1877722816151296:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790736394.572370:0:14391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941603fb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+16:15795:x1877722816151296:12345-0@lo:501:mount.lustre.0 Request processed in 454us (684us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790736394.572432:0:15795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633800a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15795:1877722816151296:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1790736394.572448:0:15795:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.105@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1790736394.572636:0:15795:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.105@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1790736394.572644:0:15795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c9c00/0x6aae200528fe7219 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe7220 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736394.572654:0:15795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff94162f8c9c00/0x6aae200528fe7219 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe7220 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790736394.572678:0:15795:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9416064e9000 10000000:01000000:2.0:1790736394.572683:0:15795:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790736394.572689:0:15795:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1790736394.572691:0:15795:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790736394.572696:0:15795:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1790736394.572699:0:15795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1790736394.572725:0:15795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff94163c526600/0x6aae200528fe7473 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736394.572739:0:15795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff94163c526600/0x6aae200528fe7473 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736394.572748:0:15795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff94163c526600/0x6aae200528fe7473 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736394.572762:0:15795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f267b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15795:1877722816151424:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790736394.572795:0:15795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736394.572825:0:15795:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611651900 going to sleep for 11 seconds 00000100:00100000:1.0:1790736394.575421:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790736394.575548:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816151424 00000100:00100000:3.0:1790736394.575557:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816151424 00000100:00100000:3.0:1790736394.575603:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790736394.575622:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941603fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+16:15795:x1877722816151424:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790736394.575641:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736394.575661:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94162f8c9400/0x6aae200528fe747a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe7473 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736394.575689:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94162f8c9400/0x6aae200528fe747a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe7473 expref: 17 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736394.575700:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94162f8c9400/0x6aae200528fe747a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe7473 expref: 17 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736394.575709:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c9400, rc 0) 00000100:00100000:3.0:1790736394.575787:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941603fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+17:15795:x1877722816151424:12345-0@lo:101:mount.lustre.0 Request processed in 171us (2986us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736394.575793:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790736394.576338:0:15795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f267b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15795:1877722816151424:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790736394.576360:0:15795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff94163c526600/0x6aae200528fe7473 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe747a expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736394.576371:0:15795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff94163c526600/0x6aae200528fe7473 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe747a expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790736394.578282:0:15795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1790736394.582720:0:15795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790736394.583366:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1790736394.583429:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1790736394.583463:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1790736394.583527:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1790736394.583561:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1790736394.583592:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1790736394.583673:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1790736394.583683:0:15795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1790736394.583778:0:15795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633800700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15795:1877722816151552:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790736394.583841:0:15795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736394.583975:0:15795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416181e9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790736394.584329:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816151552 00000100:00100000:1.0:1790736394.584338:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816151552 00000100:00100000:1.0:1790736394.584390:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790736394.584400:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941603fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+17:15795:x1877722816151552:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790736394.584846:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941603fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+17:15795:x1877722816151552:12345-0@lo:501:mount.lustre.0 Request processed in 447us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736394.585236:0:15795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633800700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15795:1877722816151552:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790736394.585278:0:15795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633800700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15795:1877722816151680:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790736394.585323:0:15795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736394.585396:0:15795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416181e9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790736394.585458:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790736394.585496:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816151680 00000100:00100000:1.0:1790736394.585501:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816151680 00000100:00100000:2.0:1790736394.589777:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790736394.589995:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941603fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+17:15795:x1877722816151680:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790736394.594588:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941603fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+17:15795:x1877722816151680:12345-0@lo:503:mount.lustre.0 Request processed in 4246us (8712us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736394.594603:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790736394.597346:0:15795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633800700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15795:1877722816151680:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790736394.602353:0:15795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790736394.602443:0:15795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15795:1877722816151808:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790736394.603652:0:15795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736394.603752:0:15795:0:(client.c:2716:ptlrpc_set_wait()) set ffff941612fd10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790736394.612945:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816151808 00000100:00100000:1.0:1790736394.612961:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816151808 00000100:00100000:2.0:1790736394.616134:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790736394.616149:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941603fba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+17:15795:x1877722816151808:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790736394.616448:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941603fba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+17:15795:x1877722816151808:12345-0@lo:502:mount.lustre.0 Request processed in 303us (12799us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736394.616457:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790736394.616621:0:15795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15795:1877722816151808:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790736394.616896:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1790736394.616957:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1790736394.616991:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1790736394.617039:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1790736394.617074:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1790736394.617143:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1790736394.617196:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1790736394.617247:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1790736394.617296:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1790736394.617336:0:15795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15795:1877722816151936:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790736394.617406:0:15795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736394.617445:0:15795:0:(client.c:2716:ptlrpc_set_wait()) set ffff941612fd10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790736394.618577:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816151936 00000100:00100000:2.0:1790736394.618588:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816151936 00000100:00100000:2.0:1790736394.618641:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790736394.618649:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941603fba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+17:15795:x1877722816151936:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790736394.621184:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941603fba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+17:15795:x1877722816151936:12345-0@lo:502:mount.lustre.0 Request processed in 2526us (3768us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736394.621198:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790736394.621315:0:15795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15795:1877722816151936:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790736394.621448:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1790736394.621526:0:15795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1790736394.623089:0:15796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790736394.623428:0:15796:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1790736394.623566:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790736394.623569:0:15796:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1790736394.623576:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790736394.623675:0:15796:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9416181e4d40) 00000020:00000080:0.0:1790736394.623701:0:15796:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1790736394.623710:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790736394.623772:0:15796:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9416064e9000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1790736394.623780:0:15796:0:(osd_handler.c:1577:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790736394.623787:0:15796:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6aae200528fe7488 00010000:00010000:0.0:1790736394.634820:0:15796:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1790736394.635417:0:15796:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1790736394.637670:0:15796:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1790736394.639567:0:15796:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1790736394.639580:0:15796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790736394.639598:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790736394.639599:0:15796:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1790736394.639603:0:15796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790736394.639607:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790736394.639787:0:15796:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790736394.639792:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790736394.639794:0:15796:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1790736394.639797:0:15796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790736394.639799:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790736394.639800:0:15796:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1790736394.639802:0:15796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790736394.639804:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790736394.639805:0:15796:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790736394.639817:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1790736394.640245:0:15796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790736394.640250:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790736394.640252:0:15796:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790736394.640256:0:15796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1790736394.640478:0:15795:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1790736394.640503:0:15795:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1790736394.640525:0:15795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94163c526600/0x6aae200528fe7473 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe747a expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736394.640537:0:15795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff94163c526600/0x6aae200528fe7473 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe747a expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790736394.640545:0:15795:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9416064e9000 from 1 10000000:01000000:3.0:1790736394.640555:0:15795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790736394.645021:0:15795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c8a00/0x6aae200528fe748f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736394.645047:0:15795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff94162f8c8a00/0x6aae200528fe748f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736394.645063:0:15795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff94162f8c8a00/0x6aae200528fe748f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736394.645107:0:15795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633800700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15795:1877722816152064:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790736394.645183:0:15795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736394.645221:0:15795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416181e9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790736394.645383:0:14391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816152064 00000100:00100000:1.0:1790736394.645392:0:14391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816152064 00000100:00100000:1.0:1790736394.645445:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790736394.645454:0:14391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941603fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+17:15795:x1877722816152064:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790736394.645469:0:14391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736394.645487:0:14391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941633c60400/0x6aae200528fe7496 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe748f expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736394.645512:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941633c60400/0x6aae200528fe7496 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe748f expref: 18 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736394.645522:0:14391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941633c60400/0x6aae200528fe7496 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe748f expref: 18 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736394.645531:0:14391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c60400, rc 0) 00000100:00100000:1.0:1790736394.645581:0:14391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941603fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+18:15795:x1877722816152064:12345-0@lo:101:mount.lustre.0 Request processed in 128us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736394.645588:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790736394.646300:0:15795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633800700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15795:1877722816152064:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790736394.646320:0:15795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff94162f8c8a00/0x6aae200528fe748f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe7496 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736394.646330:0:15795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff94162f8c8a00/0x6aae200528fe748f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe7496 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790736394.647027:0:15795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1790736394.649285:0:15795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790736394.649549:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1790736394.649592:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1790736394.649667:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1790736394.649676:0:15795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1790736394.649764:0:15795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633800700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15795:1877722816152192:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790736394.649829:0:15795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736394.649940:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816152192 00000100:00100000:0.0:1790736394.649948:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816152192 00000100:00100000:0.0:1790736394.649998:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790736394.650019:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941603fb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+18:15795:x1877722816152192:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790736394.658847:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941603fb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+18:15795:x1877722816152192:12345-0@lo:501:mount.lustre.0 Request processed in 8832us (9009us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736394.658863:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790736394.663163:0:15795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416181e9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790736394.663205:0:15795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633800700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15795:1877722816152192:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790736394.663270:0:15795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633800700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15795:1877722816152320:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790736394.663333:0:15795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736394.663354:0:15795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416181e9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790736394.664231:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816152320 00000100:00100000:0.0:1790736394.664242:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816152320 00000100:00100000:0.0:1790736394.664292:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790736394.664301:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941603fb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+18:15795:x1877722816152320:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790736394.664537:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941603fb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+18:15795:x1877722816152320:12345-0@lo:503:mount.lustre.0 Request processed in 236us (1203us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736394.664545:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790736394.665047:0:15795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633800700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15795:1877722816152320:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790736394.665576:0:15795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790736394.665681:0:15795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633800700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15795:1877722816152448:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790736394.665737:0:15795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736394.665781:0:15795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416181e9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790736394.666115:0:14391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816152448 00000100:00100000:0.0:1790736394.666122:0:14391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816152448 00000100:00100000:0.0:1790736394.666155:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790736394.666162:0:14391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162e4e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+18:15795:x1877722816152448:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790736394.666342:0:14391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162e4e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+18:15795:x1877722816152448:12345-0@lo:502:mount.lustre.0 Request processed in 180us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736394.666349:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790736394.667446:0:15795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633800700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15795:1877722816152448:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790736394.667741:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1790736394.667798:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1790736394.667846:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1790736394.667880:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1790736394.667907:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1790736394.667951:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1790736394.667986:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1790736394.668020:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1790736394.668143:0:15795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633800700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15795:1877722816152576:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790736394.668206:0:15795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736394.668247:0:15795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416181e9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790736394.668270:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816152576 00000100:00100000:0.0:1790736394.668277:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816152576 00000100:00100000:0.0:1790736394.668332:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790736394.668340:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162e4e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+18:15795:x1877722816152576:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790736394.668535:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162e4e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+18:15795:x1877722816152576:12345-0@lo:502:mount.lustre.0 Request processed in 195us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736394.668543:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790736394.672752:0:15795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633800700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15795:1877722816152576:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790736394.672965:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1790736394.672982:0:15795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1790736394.674427:0:15800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790736394.674439:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790736394.674441:0:15800:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790736394.674447:0:15800:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9416064e9000 00000020:00000080:0.0:1790736394.674449:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790736394.674456:0:15800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790736394.674458:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790736394.674459:0:15800:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1790736394.674462:0:15800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790736394.674474:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790736394.674475:0:15800:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790736394.674479:0:15800:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9416064e9000 00000020:00000080:0.0:1790736394.674481:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790736394.674557:0:15800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790736394.674560:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790736394.674562:0:15800:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1790736394.674565:0:15800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790736394.674567:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790736394.674569:0:15800:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790736394.674572:0:15800:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9416064e9000 00000020:00000080:0.0:1790736394.674574:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790736394.674630:0:15800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790736394.674634:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790736394.674635:0:15800:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1790736394.674639:0:15800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1790736394.679964:0:15795:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1790736394.680005:0:15795:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790736394.680031:0:15795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c8a00/0x6aae200528fe748f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe7496 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736394.680057:0:15795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff94162f8c8a00/0x6aae200528fe748f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe7496 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790736394.680126:0:15795:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790736394.680129:0:15795:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9416064e9000 10000000:01000000:3.0:1790736394.680132:0:15795:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9416064e9000 10000000:01000000:3.0:1790736394.680137:0:15795:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790736394.680143:0:15795:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9416064e9000 from 1 10000000:01000000:3.0:1790736394.680145:0:15795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790736394.680180:0:15795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c8e00/0x6aae200528fe749d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736394.680189:0:15795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff94162f8c8e00/0x6aae200528fe749d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736394.680199:0:15795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff94162f8c8e00/0x6aae200528fe749d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736394.680224:0:15795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633800700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15795:1877722816152704:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790736394.680290:0:15795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736394.680333:0:15795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416181e9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790736394.680356:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816152704 00000100:00100000:3.0:1790736394.680364:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816152704 00000100:00100000:3.0:1790736394.680410:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790736394.680419:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162e4e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+18:15795:x1877722816152704:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790736394.680432:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736394.680444:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94162f8c9a00/0x6aae200528fe74a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe749d expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736394.680478:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94162f8c9a00/0x6aae200528fe74a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe749d expref: 19 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736394.680489:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94162f8c9a00/0x6aae200528fe74a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe749d expref: 19 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736394.680498:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162f8c9a00, rc 0) 00000100:00100000:3.0:1790736394.680535:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162e4e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+19:15795:x1877722816152704:12345-0@lo:101:mount.lustre.0 Request processed in 117us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736394.680542:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790736394.680586:0:15795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633800700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15795:1877722816152704:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790736394.680599:0:15795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff94162f8c8e00/0x6aae200528fe749d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe74a4 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736394.680620:0:15795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff94162f8c8e00/0x6aae200528fe749d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe74a4 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790736394.681238:0:15795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1790736394.681515:0:15795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790736394.681760:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1790736394.681803:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1790736394.681839:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1790736394.681900:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1790736394.681937:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1790736394.681987:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1790736394.682023:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1790736394.682058:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1790736394.682134:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1790736394.682180:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1790736394.682213:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1790736394.682281:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1790736394.682318:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1790736394.682350:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1790736394.682406:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1790736394.682446:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1790736394.682480:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1790736394.682527:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1790736394.682562:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1790736394.682623:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1790736394.682673:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1790736394.682709:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1790736394.682742:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1790736394.682786:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1790736394.682818:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1790736394.682849:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1790736394.682896:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1790736394.682931:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1790736394.682967:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1790736394.683016:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1790736394.683053:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1790736394.683086:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1790736394.683150:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1790736394.683196:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1790736394.683231:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1790736394.683287:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1790736394.683325:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1790736394.683413:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1790736394.683421:0:15795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1790736394.683511:0:15795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633800700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15795:1877722816152832:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790736394.683570:0:15795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736394.683948:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816152832 00000100:00100000:0.0:1790736394.683957:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816152832 00000100:00100000:0.0:1790736394.684018:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790736394.684027:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162e4e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+19:15795:x1877722816152832:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790736394.684345:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162e4e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+19:15795:x1877722816152832:12345-0@lo:501:mount.lustre.0 Request processed in 319us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736394.684353:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790736394.697302:0:15795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416181e9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790736394.697351:0:15795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633800700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15795:1877722816152832:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790736394.697414:0:15795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f267b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15795:1877722816152960:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790736394.697574:0:15795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736394.697629:0:15795:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611651840 going to sleep for 11 seconds 00000100:00100000:1.0:1790736394.697648:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816152960 00000100:00100000:1.0:1790736394.697656:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816152960 00000100:00100000:1.0:1790736394.697711:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790736394.697721:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162e4e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+19:15795:x1877722816152960:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790736394.698012:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162e4e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+19:15795:x1877722816152960:12345-0@lo:503:mount.lustre.0 Request processed in 292us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736394.698021:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790736394.700059:0:15795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f267b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15795:1877722816152960:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790736394.702230:0:15795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790736394.702351:0:15795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f267b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15795:1877722816153088:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790736394.702438:0:15795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736394.702483:0:14391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816153088 00000100:00100000:1.0:1790736394.702491:0:14391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816153088 00000100:00100000:1.0:1790736394.702537:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790736394.702546:0:14391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162e4e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+19:15795:x1877722816153088:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790736394.702775:0:14391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162e4e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+19:15795:x1877722816153088:12345-0@lo:502:mount.lustre.0 Request processed in 230us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736394.702783:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790736394.703947:0:15795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416039e50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790736394.703986:0:15795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f267b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15795:1877722816153088:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790736394.710047:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1790736394.710224:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1790736394.710263:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1790736394.710316:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1790736394.710353:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1790736394.710406:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1790736394.710441:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1790736394.710495:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1790736394.710545:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1790736394.712015:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1790736394.712125:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1790736394.712494:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1790736394.712538:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1790736394.712577:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1790736394.715012:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1790736394.715118:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1790736394.715172:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1790736394.715239:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1790736394.715277:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1790736394.715311:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1790736394.715360:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1790736394.715399:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1790736394.715434:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1790736394.715503:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1790736394.715541:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1790736394.715577:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1790736394.715637:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1790736394.715673:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1790736394.715706:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1790736394.715756:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1790736394.715792:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1790736394.715827:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1790736394.715861:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1790736394.715910:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1790736394.715948:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1790736394.715996:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1790736394.716033:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1790736394.716069:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1790736394.716162:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1790736394.716219:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1790736394.716271:0:15795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f267b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15795:1877722816153216:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790736394.716351:0:15795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736394.716403:0:15795:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611651840 going to sleep for 11 seconds 00000100:00100000:1.0:1790736394.716489:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816153216 00000100:00100000:1.0:1790736394.716498:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816153216 00000100:00100000:1.0:1790736394.716545:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790736394.716554:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162e4e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+19:15795:x1877722816153216:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790736394.716791:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162e4e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+19:15795:x1877722816153216:12345-0@lo:502:mount.lustre.0 Request processed in 237us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736394.716799:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790736394.717020:0:15795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f267b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15795:1877722816153216:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790736394.717135:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1790736394.717146:0:15795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1790736394.718307:0:15805:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1790736394.718333:0:15805:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff941502b44d40) 00000020:00000080:3.0:1790736394.718355:0:15805:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1790736394.718435:0:15805:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9416064e9000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1790736394.718440:0:15805:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9416064e9000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1790736394.718442:0:15805:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9416064e9000 3 00010000:00080000:3.0:1790736394.718534:0:15805:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94163c633800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.105@tcp at head 00010000:00010000:3.0:1790736394.720457:0:15805:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1790736394.720671:0:15805:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1790736394.720707:0:15805:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790736394.720718:0:15805:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x6aae200528fe74b2 00000100:00080000:3.0:1790736394.720728:0:15805:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790736394.720738:0:15805:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff94163c633800 using connection 192.168.203.105@tcp/0@lo 00000100:00100000:3.0:1790736394.720790:0:15805:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff941633800000 x1877722816153344/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790736394.720823:0:15805:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790736394.720998:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790736394.721003:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1790736394.721006:0:479:0:(import.c:65:import_set_state_nolock()) ffff94161196b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790736394.721010:0:479:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 462 00000100:00080000:1.0:1790736394.721015:0:479:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1790736394.721019:0:479:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff94161196b800 using connection 192.168.203.105@tcp/0@lo 00000100:00100000:1.0:1790736394.721042:0:479:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff941642041f80 x1877722816153600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790736394.721130:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941642043b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1877722816153856:0@lo:400:kworker.0 00000100:00100000:1.0:1790736394.721194:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736394.721229:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790736394.721237:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941642043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877722816153728:0@lo:400:kworker.0 00000100:00100000:1.0:1790736394.721258:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736394.721283:0:14398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816153856 00000100:00100000:1.0:1790736394.721289:0:14398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816153856 00000100:00100000:1.0:1790736394.721331:0:14398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816153728 00000100:00100000:1.0:1790736394.721334:0:14398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816153728 00000100:00100000:1.0:1790736394.721347:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790736394.721355:0:14398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642040700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877722816153856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736394.721407:0:14398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642040700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877722816153856:12345-0@lo:400:kworker.0 Request processed in 52us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736394.721415:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790736394.721428:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790736394.721434:0:14398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877722816153728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736394.721461:0:14398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877722816153728:12345-0@lo:400:kworker.0 Request processed in 28us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736394.721467:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1790736394.721486:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790736394.721629:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff941642043480 x1877722816153728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790736410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736394.721643:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941642043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877722816153728:0@lo:400:kworker.0 00010000:00080000:1.0:1790736394.721654:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff941642043b80 x1877722816153856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790736410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736394.721675:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941642043b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1877722816153856:0@lo:400:kworker.0 00000100:00100000:0.0:1790736394.722406:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941642041880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816153472:0@lo:400:kworker.0 00000100:00100000:0.0:1790736394.722452:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736394.723006:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633800000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1877722816153344:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790736394.723050:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736394.723088:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941642041f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1877722816153600:0@lo:8:kworker.0 00000100:00100000:2.0:1790736394.723129:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736394.723164:0:15081:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816153472 00000100:00100000:1.0:1790736394.723172:0:15081:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816153472 00000100:00100000:2.0:1790736394.723173:0:14398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816153344 00000100:00100000:2.0:1790736394.723180:0:14398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816153344 00000100:00100000:2.0:1790736394.723213:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790736394.723219:0:14398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1877722816153344:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790736394.723225:0:15081:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816153600 00000100:00100000:1.0:1790736394.723230:0:15081:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816153600 00000100:00100000:1.0:1790736394.723243:0:15081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790736394.723247:0:14398:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 466 last 0 00000100:00100000:1.0:1790736394.723253:0:15081:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3309:x1877722816153472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736394.723267:0:15078:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1790736394.723275:0:15078:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000020:00000080:2.0:1790736394.723289:0:14398:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x6aae200528fe74b9 00000004:00100000:2.0:1790736394.723306:0:14398:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1790736394.723310:0:15081:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3309:x1877722816153472:12345-0@lo:400:kworker.0 Request processed in 59us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736394.723320:0:15081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790736394.723338:0:15081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1790736394.723339:0:14398:0:(import.c:65:import_set_state_nolock()) ffff94162ed8f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790736394.723344:0:15081:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3305:x1877722816153600:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1790736394.723371:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941642041880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816153472:0@lo:400:kworker.0 00000100:00100000:2.0:1790736394.723384:0:14398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877722816153344:12345-0@lo:38:llog_process_th.0 Request processed in 164us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736394.723393:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790736394.723397:0:15081:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3305:x1877722816153600:12345-0@lo:8:kworker.0 Request processed in 49us (263us total) trans 0 rc -11/-11 00000100:00100000:1.0:1790736394.723406:0:15081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1790736394.723429:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790736394.723432:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff941633800000 x1877722816153344/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790736404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790736394.723443:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790736394.723449:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1790736394.723456:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790736394.723461:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790736394.723464:0:3305:0:(import.c:65:import_set_state_nolock()) ffff94163c633800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790736394.723469:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633800000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1877722816153344:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790736394.723480:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790736394.723483:0:3305:0:(import.c:65:import_set_state_nolock()) ffff94161196b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790736394.723487:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1790736394.723490:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941642041f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1877722816153600:0@lo:8:kworker.0 00000040:00080000:1.0:1790736394.723763:0:15805:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1790736394.724152:0:15795:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1790736394.724176:0:15795:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790736394.724198:0:15795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c8e00/0x6aae200528fe749d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe74a4 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736394.724215:0:15795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff94162f8c8e00/0x6aae200528fe749d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe74a4 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790736394.724256:0:15795:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790736394.724259:0:15795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790736394.724261:0:15795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790736394.724262:0:15795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790736394.724264:0:15795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790736394.724265:0:15795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790736394.724267:0:15795:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790736394.724269:0:15795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790736394.724270:0:15795:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790736394.724274:0:15795:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1790736394.724276:0:15795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790736394.724277:0:15795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790736394.724278:0:15795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790736394.724279:0:15795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790736394.724280:0:15795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790736394.724280:0:15795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790736394.724281:0:15795:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790736394.724282:0:15795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790736394.724283:0:15795:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790736394.724303:0:15795:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1790736394.724316:0:15795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94162f267100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15795:1877722816153984:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790736394.724362:0:15795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736394.724396:0:15795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416181e9840 going to sleep for 11 seconds 00000100:00100000:2.0:1790736394.724414:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816153984 00000100:00100000:2.0:1790736394.724420:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816153984 00000100:00100000:2.0:1790736394.724454:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790736394.724462:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162e4e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+19:15795:x1877722816153984:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790736394.724501:0:14389:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1790736394.724523:0:14389:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1790736394.764619:0:14389:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790736394.764640:0:14389:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1790736394.764713:0:14412:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790736394.764718:0:14412:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790736394.764742:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94163be29600/0x6aae200528fe74c0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736394.764761:0:14412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94163c526a00/0x6aae200528fe739a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe7393 expref: 19 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736394.764769:0:14412:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94163be29600/0x6aae200528fe74c0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736394.764810:0:14412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94163c526a00/0x6aae200528fe739a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6aae200528fe7393 expref: 19 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736394.764824:0:14412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94163c526a00/0x6aae200528fe739a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6aae200528fe7393 expref: 19 pid: 14389 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736394.764937:0:14412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae1880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14412:1877722816154112:0@lo:104: 00000100:00100000:0.0:1790736394.765017:0:14412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736394.765117:0:14412:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611ce2240 going to sleep for 11 seconds 00000100:00100000:2.0:1790736394.765238:0:14379:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816154112 00000100:00100000:2.0:1790736394.765246:0:14379:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816154112 00000100:00100000:2.0:1790736394.765290:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790736394.765298:0:14379:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+3:14412:x1877722816154112:12345-0@lo:104: 00010000:00010000:2.0:1790736394.765311:0:14379:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff94162f8c8800/0x6aae200528fe7393 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe739a expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736394.765360:0:14379:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790736394.765365:0:14379:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+3:14412:x1877722816154112:12345-0@lo:104: Request processed in 69us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736394.765372:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1790736394.765436:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790736394.765442:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff94162f8c8800/0x6aae200528fe7393 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe739a expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736394.765450:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c8800 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:0.0:1790736394.765454:0:14384:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff94162f8c8800/0x6aae200528fe7393 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6aae200528fe739a expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736394.765463:0:14384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff94162f8c8800/0x6aae200528fe7393 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6aae200528fe739a expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790736394.765535:0:14384:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff94162f8c8800/0x6aae200528fe7393 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6aae200528fe739a expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790736394.765541:0:14384:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790736394.765602:0:14384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff94162f8c8800/0x6aae200528fe7393 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe739a expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736394.765618:0:14384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790736394.765638:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff94162f8c8800/0x6aae200528fe7393 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe739a expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736394.765646:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff94162f8c8800/0x6aae200528fe7393 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe739a expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736394.765667:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736394.765669:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736394.765671:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790736394.765682:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd61a3fa-9892-475c-9015-fd1ddc473c5e:3308:1877722816154240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790736394.765712:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736394.765781:0:14412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae1880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14412:1877722816154112:0@lo:104: 00010000:00010000:0.0:1790736394.765798:0:14412:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94163be29600/0x6aae200528fe74c0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736394.766707:0:14383:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816154240 00000100:00100000:3.0:1790736394.766716:0:14383:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816154240 00010000:00010000:3.0:1790736394.766743:0:14383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94163c526a00/0x6aae200528fe739a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe7393 expref: 20 pid: 14389 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736394.766772:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790736394.766779:0:14383:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+20:3308:x1877722816154240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790736394.766792:0:14383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790736394.766797:0:14383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94163c526a00/0x6aae200528fe739a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe7393 expref: 20 pid: 14389 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736394.766819:0:14383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94163c526a00/0x6aae200528fe739a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6aae200528fe7393 expref: 20 pid: 14389 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736394.766844:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94163c526a00/0x6aae200528fe739a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6aae200528fe7393 expref: 20 pid: 14389 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736394.766859:0:14383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94163be29600/0x6aae200528fe74c0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736394.766866:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94163be29600/0x6aae200528fe74c0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790736394.766880:0:14383:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002496010s 00010000:00010000:3.0:1790736394.766884:0:14383:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94163be29600/0x6aae200528fe74c0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736394.766891:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94163be29600/0x6aae200528fe74c0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736394.766899:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94163be29600/0x6aae200528fe74c0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736394.766906:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94163be29600/0x6aae200528fe74c0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736394.766912:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163be29600 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:3.0:1790736394.766916:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94163be29600/0x6aae200528fe74c0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736394.766923:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94163be29600/0x6aae200528fe74c0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736394.766942:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94163be29600/0x6aae200528fe74c0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736394.766953:0:14383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790736394.767000:0:14383:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+19:3308:x1877722816154240:12345-0@lo:103:ldlm_bl.0 Request processed in 221us (1286us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736394.767007:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790736394.767216:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd61a3fa-9892-475c-9015-fd1ddc473c5e:3308:1877722816154240:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790736394.767239:0:14412:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94163be29600/0x6aae200528fe74c0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736394.767248:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94163be29600/0x6aae200528fe74c0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736394.767254:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94163be29600/0x6aae200528fe74c0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736394.772524:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162e4e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+18:15795:x1877722816153984:12345-0@lo:253:mount.lustre.0 Request processed in 48053us (48151us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736394.772538:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790736394.772990:0:15795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94162f267100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd61a3fa-9892-475c-9015-fd1ddc473c5e:15795:1877722816153984:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790736394.773005:0:15795:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1790736394.773009:0:15795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790736394.773011:0:15795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790736394.773012:0:15795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790736394.773013:0:15795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790736394.773014:0:15795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790736394.773015:0:15795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790736394.773017:0:15795:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790736394.773019:0:15795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790736394.773020:0:15795:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790736394.773268:0:15795:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1790736394.782584:0:15795:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1790736394.782765:0:15795:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1790736394.782986:0:15795:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1790736394.783233:0:15795:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1790736394.783367:0:15795:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1790736394.783661:0:15795:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1790736394.784698:0:15795:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1790736394.842817:0:15795:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1790736394.842827:0:15795:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1790736394.842927:0:15795:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790736394.842978:0:15795:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.105@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790736394.842992:0:15795:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1790736394.843017:0:15795:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000001:00100000:2.0:1790736395.067713:0:6725:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1790736395.067732:0:6725:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:1.0:1790736395.351330:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790736395.927298:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633803480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816154368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790736395.927368:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736395.927487:0:15082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816154368 00000100:00100000:3.0:1790736395.927496:0:15082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816154368 00000100:00100000:3.0:1790736395.927539:0:15082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790736395.927549:0:15082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816154368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790736395.927582:0:15082:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790736395.927653:0:15082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816154368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736395.927660:0:15082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790736395.930741:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1790736395.930775:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633803480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816154368:0@lo:13:osp-pre-0-0.0 10000000:01000000:3.0:1790736396.376430:0:14393:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790736396.376439:0:14393:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94163af23800 from 8 10000000:01000000:3.0:1790736396.376444:0:14393:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790736396.376509:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c8000/0x6aae200528fe74c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736396.376545:0:14393:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff94162f8c8000/0x6aae200528fe74c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736396.376561:0:14393:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff94162f8c8000/0x6aae200528fe74c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736396.376594:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633803b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14393:1877722816154496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790736396.376704:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736396.376776:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff941633e2b300 going to sleep for 11 seconds 00000100:00100000:0.0:1790736396.379226:0:14391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816154496 00000100:00100000:0.0:1790736396.379242:0:14391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816154496 00000100:00100000:0.0:1790736396.379321:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790736396.379333:0:14391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162e4e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+18:14393:x1877722816154496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790736396.379370:0:14391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736396.379396:0:14391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94163be29800/0x6aae200528fe74ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe74c7 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736396.379431:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94163be29800/0x6aae200528fe74ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe74c7 expref: 19 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736396.379445:0:14391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94163be29800/0x6aae200528fe74ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe74c7 expref: 19 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736396.379472:0:14391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94163be29800, rc 0) 00000100:00100000:0.0:1790736396.379569:0:14391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162e4e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+19:14393:x1877722816154496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 237us (2864us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736396.379576:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790736396.380065:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633803b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14393:1877722816154496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790736396.380089:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff94162f8c8000/0x6aae200528fe74c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe74ce expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736396.380118:0:14393:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff94162f8c8000/0x6aae200528fe74c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe74ce expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736396.380200:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633803b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14393:1877722816154624:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1790736396.380254:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736396.380306:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff941633e2b300 going to sleep for 11 seconds 00000100:00100000:0.0:1790736396.382016:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816154624 00000100:00100000:0.0:1790736396.382035:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816154624 00000100:00100000:0.0:1790736396.382119:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790736396.382131:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162e4e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+19:14393:x1877722816154624:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790736396.382165:0:14389:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790736396.382194:0:14389:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790736396.382197:0:14389:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1790736396.382361:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162e4e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+19:14393:x1877722816154624:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 232us (2105us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736396.382369:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790736396.382373:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633803b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14393:1877722816154624:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1790736396.382508:0:14393:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790736396.382520:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff94162f8c8000/0x6aae200528fe74c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe74ce expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736396.382533:0:14393:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff94162f8c8000/0x6aae200528fe74c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe74ce expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736396.383942:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736397.398244:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790736397.974253:0:14427:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790736398.422363:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736399.452758:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790736400.023534:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790736400.023541:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790736400.023544:0:479:0:(import.c:65:import_set_state_nolock()) ffff94161196b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790736400.023559:0:479:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff94161196b800 using connection 192.168.203.105@tcp/0@lo 00000100:00100000:3.0:1790736400.023589:0:479:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff941633800e00 x1877722816155008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790736400.023672:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd61a3fa-9892-475c-9015-fd1ddc473c5e:3306:1877722816154752:0@lo:400:kworker.0 00000100:00100000:3.0:1790736400.023738:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736400.023796:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633803480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1877722816155392:0@lo:400:kworker.0 00000100:00100000:3.0:1790736400.024908:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736400.024940:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790736400.024948:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816154880:0@lo:400:kworker.0 00000100:00100000:3.0:1790736400.024978:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736400.025008:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633800e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1877722816155008:0@lo:8:kworker.0 00000100:00100000:3.0:1790736400.025028:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736400.025052:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877722816155136:0@lo:400:kworker.0 00000100:00100000:3.0:1790736400.025071:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736400.025086:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790736400.025090:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633802680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1877722816155264:0@lo:400:kworker.0 00000100:00100000:2.0:1790736400.025240:0:14396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816155392 00000100:00100000:2.0:1790736400.025249:0:14396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816155392 00000100:00100000:2.0:1790736400.025297:0:14396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816155136 00000100:00100000:2.0:1790736400.025300:0:14396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816155136 00000100:00100000:2.0:1790736400.025313:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790736400.025321:0:14396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877722816155392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736400.025372:0:14396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877722816155392:12345-0@lo:400:kworker.0 Request processed in 52us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736400.025380:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790736400.025396:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790736400.025402:0:14396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633801f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877722816155136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736400.025439:0:14396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633801f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877722816155136:12345-0@lo:400:kworker.0 Request processed in 37us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736400.025444:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1790736400.025461:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790736400.026200:0:15079:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816154880 00000100:00100000:1.0:1790736400.026207:0:15079:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816154880 00000100:00100000:1.0:1790736400.026242:0:15079:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816155008 00000100:00100000:1.0:1790736400.026245:0:15079:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816155008 00000100:00100000:1.0:1790736400.026260:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790736400.026279:0:15079:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816154880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736400.026322:0:15079:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816154880:12345-0@lo:400:kworker.0 Request processed in 45us (1343us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736400.026328:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790736400.026341:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790736400.026345:0:15079:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1877722816155008:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1790736400.026367:0:15079:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:1.0:1790736400.026393:0:15079:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6aae200528fe74d5 00002000:00100000:1.0:1790736400.026407:0:15079:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff941610b33000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1790736400.026411:0:15079:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1790736400.026413:0:15079:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1790736400.026749:0:15079:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1790736400.026771:0:15079:0:(import.c:65:import_set_state_nolock()) ffff941610b36800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790736400.026817:0:15079:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1877722816155008:12345-0@lo:8:kworker.0 Request processed in 471us (1787us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736400.026823:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790736400.026844:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816154752 00000100:00100000:1.0:1790736400.026849:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816154752 00000100:00100000:1.0:1790736400.026875:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790736400.026881:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162e4e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+19:3306:x1877722816154752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736400.026912:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162e4e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+19:3306:x1877722816154752:12345-0@lo:400:kworker.0 Request processed in 32us (3174us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736400.026918:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1790736400.026952:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790736400.027010:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816154880:0@lo:400:kworker.0 00000100:00100000:1.0:1790736400.027021:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd61a3fa-9892-475c-9015-fd1ddc473c5e:3306:1877722816154752:0@lo:400:kworker.0 00010000:00080000:1.0:1790736400.027046:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff941633803480 x1877722816155392/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790736416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790736400.027056:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633803480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1877722816155392:0@lo:400:kworker.0 00000100:00100000:3.0:1790736400.027329:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1790736400.027371:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff941633803100 x1877722816155136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790736416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736400.027393:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877722816155136:0@lo:400:kworker.0 00010000:00080000:3.0:1790736400.027420:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff941633800e00 x1877722816155008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790736425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790736400.027432:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1790736400.027439:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1790736400.027444:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1790736400.027446:0:3305:0:(import.c:65:import_set_state_nolock()) ffff94161196b800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1790736400.027501:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1790736400.027506:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633800e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1877722816155008:0@lo:8:kworker.0 00000004:00080000:3.0:1790736400.027552:0:14421:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:3.0:1790736400.027581:0:14421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633803100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14421:1877722816155648:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1790736400.027607:0:14421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736400.027623:0:14421:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416038db840 going to sleep for 11 seconds 00000100:00100000:3.0:1790736400.027636:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633800e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816155520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790736400.027659:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736400.027687:0:15082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816155520 00000100:00100000:3.0:1790736400.027692:0:15082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816155520 00000100:00100000:3.0:1790736400.027724:0:15082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790736400.027731:0:15082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633801500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1877722816155520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790736400.027753:0:15082:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790736400.027788:0:15082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633801500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1877722816155520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736400.027795:0:15082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1790736400.027823:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff941633800e00 x1877722816155520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790736416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736400.027844:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633800e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816155520:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1790736400.027860:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790736400.027870:0:15079:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816155648 00000100:00100000:3.0:1790736400.027873:0:15079:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816155648 00000100:00100000:3.0:1790736400.027896:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790736400.027901:0:15079:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14421:x1877722816155648:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1790736400.029788:0:14420:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1790736400.030254:0:14396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816155264 00000100:00100000:0.0:1790736400.030264:0:14396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816155264 00000100:00100000:0.0:1790736400.030317:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790736400.030325:0:14396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633802300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877722816155264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736400.030409:0:14396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633802300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877722816155264:12345-0@lo:400:kworker.0 Request processed in 84us (3079us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736400.030415:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:1.0:1790736400.031032:0:14420:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 472041937238ns, next at 0ns, rc = 0 00000100:00080000:3.0:1790736400.037945:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790736400.038071:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff941633802680 x1877722816155264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790736416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790736400.038086:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633802680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1877722816155264:0@lo:400:kworker.0 00002000:00080000:3.0:1790736400.046121:0:15079:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1790736400.046132:0:15079:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1790736400.046138:0:15079:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:3.0:1790736400.055344:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790736400.055355:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074f72480/0x6aae200528fe74dc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.055373:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1790736400.055378:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790736400.055384:0:15079:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074f72480/0x6aae200528fe74dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.055401:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074f72480/0x6aae200528fe74dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.055423:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074f72480/0x6aae200528fe74dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.055431:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074f72480/0x6aae200528fe74dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.055448:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790736400.055936:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790736400.055943:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006eaa3fa5/0x6aae200528fe74e3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.055952:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1790736400.055955:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790736400.055959:0:15079:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006eaa3fa5/0x6aae200528fe74e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.055968:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006eaa3fa5/0x6aae200528fe74e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.055975:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006eaa3fa5/0x6aae200528fe74e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.055981:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006eaa3fa5/0x6aae200528fe74e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.056010:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790736400.056025:0:14385:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790736400.056030:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074f72480/0x6aae200528fe74dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.056038:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642173200 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:3.0:1790736400.056043:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074f72480/0x6aae200528fe74dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.056052:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074f72480/0x6aae200528fe74dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.056069:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074f72480/0x6aae200528fe74dc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.056077:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074f72480/0x6aae200528fe74dc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.056118:0:14385:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790736400.056122:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006eaa3fa5/0x6aae200528fe74e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.056128:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642173c00 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:3.0:1790736400.056133:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006eaa3fa5/0x6aae200528fe74e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.056152:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006eaa3fa5/0x6aae200528fe74e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.056163:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006eaa3fa5/0x6aae200528fe74e3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.056171:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006eaa3fa5/0x6aae200528fe74e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.056185:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736400.056188:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736400.056189:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790736400.056655:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790736400.056661:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6826a93/0x6aae200528fe74ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.056670:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1790736400.056673:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790736400.056677:0:15079:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6826a93/0x6aae200528fe74ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.056686:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6826a93/0x6aae200528fe74ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.056694:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6826a93/0x6aae200528fe74ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.056707:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6826a93/0x6aae200528fe74ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.056721:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790736400.056731:0:14385:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790736400.056734:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6826a93/0x6aae200528fe74ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.056740:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c8800 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:3.0:1790736400.056742:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6826a93/0x6aae200528fe74ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.056749:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6826a93/0x6aae200528fe74ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.056759:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6826a93/0x6aae200528fe74ea lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.056765:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6826a93/0x6aae200528fe74ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.056777:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736400.056779:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736400.056780:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790736400.057174:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790736400.057188:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001823ed7e/0x6aae200528fe74f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.057196:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1790736400.057200:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790736400.057204:0:15079:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001823ed7e/0x6aae200528fe74f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.057214:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001823ed7e/0x6aae200528fe74f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.057221:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001823ed7e/0x6aae200528fe74f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.057228:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001823ed7e/0x6aae200528fe74f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.057243:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790736400.057251:0:14385:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790736400.057255:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001823ed7e/0x6aae200528fe74f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.057261:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162156fc00 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:3.0:1790736400.057264:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001823ed7e/0x6aae200528fe74f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.057271:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001823ed7e/0x6aae200528fe74f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.057288:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001823ed7e/0x6aae200528fe74f1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.057295:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001823ed7e/0x6aae200528fe74f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.057310:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736400.057311:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736400.057313:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736400.058239:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790736400.063589:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790736400.063602:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c44bc229/0x6aae200528fe74f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.063619:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1790736400.063624:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790736400.063631:0:15079:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c44bc229/0x6aae200528fe74f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.063644:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c44bc229/0x6aae200528fe74f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.063655:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c44bc229/0x6aae200528fe74f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.063663:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c44bc229/0x6aae200528fe74f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.063742:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790736400.064245:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790736400.064252:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f0fa9b3/0x6aae200528fe74ff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.064261:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1790736400.064265:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790736400.064269:0:15079:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f0fa9b3/0x6aae200528fe74ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.064277:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f0fa9b3/0x6aae200528fe74ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.064283:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f0fa9b3/0x6aae200528fe74ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.064289:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f0fa9b3/0x6aae200528fe74ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736400.069707:0:14385:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790736400.069725:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c44bc229/0x6aae200528fe74f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736400.069755:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162156ee00 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:0.0:1790736400.069760:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c44bc229/0x6aae200528fe74f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736400.069770:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c44bc229/0x6aae200528fe74f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736400.069969:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c44bc229/0x6aae200528fe74f8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736400.069979:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c44bc229/0x6aae200528fe74f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736400.070010:0:14385:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790736400.070014:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f0fa9b3/0x6aae200528fe74ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736400.070020:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162156f000 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:0.0:1790736400.070024:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f0fa9b3/0x6aae200528fe74ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736400.070031:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f0fa9b3/0x6aae200528fe74ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736400.070042:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f0fa9b3/0x6aae200528fe74ff lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736400.070058:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736400.070065:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736400.070067:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736400.070991:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790736400.071003:0:15079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f0fa9b3/0x6aae200528fe74ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.071044:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790736400.072331:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790736400.072348:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd397eaa/0x6aae200528fe7506 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.072365:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1790736400.072371:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790736400.072376:0:15079:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd397eaa/0x6aae200528fe7506 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.072390:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd397eaa/0x6aae200528fe7506 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.072400:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd397eaa/0x6aae200528fe7506 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.072409:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd397eaa/0x6aae200528fe7506 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.072506:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790736400.072522:0:14385:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790736400.072528:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd397eaa/0x6aae200528fe7506 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.072536:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162156e200 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:3.0:1790736400.072540:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd397eaa/0x6aae200528fe7506 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.072549:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd397eaa/0x6aae200528fe7506 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.072582:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd397eaa/0x6aae200528fe7506 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.072591:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd397eaa/0x6aae200528fe7506 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.072611:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736400.072612:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736400.072614:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790736400.074046:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790736400.074057:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b29497f0/0x6aae200528fe750d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.074070:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1790736400.074074:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790736400.074080:0:15079:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b29497f0/0x6aae200528fe750d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.074548:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b29497f0/0x6aae200528fe750d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.074561:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b29497f0/0x6aae200528fe750d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.074578:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b29497f0/0x6aae200528fe750d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.074614:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790736400.074773:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790736400.074781:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b29497f0/0x6aae200528fe750d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.074887:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162156fe00 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:2.0:1790736400.074892:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b29497f0/0x6aae200528fe750d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.074902:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b29497f0/0x6aae200528fe750d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.074933:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b29497f0/0x6aae200528fe750d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.074942:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b29497f0/0x6aae200528fe750d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.074964:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736400.074966:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736400.074967:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790736400.076007:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790736400.076016:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd6fb098/0x6aae200528fe7514 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.076028:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1790736400.076032:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790736400.076037:0:15079:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6fb098/0x6aae200528fe7514 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.076048:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd6fb098/0x6aae200528fe7514 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.076056:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd6fb098/0x6aae200528fe7514 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.076064:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6fb098/0x6aae200528fe7514 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.076506:0:14385:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790736400.076514:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd6fb098/0x6aae200528fe7514 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.076520:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1790736400.076525:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162156e600 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:2.0:1790736400.076530:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd6fb098/0x6aae200528fe7514 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.076540:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd6fb098/0x6aae200528fe7514 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.076556:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd6fb098/0x6aae200528fe7514 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.076564:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd6fb098/0x6aae200528fe7514 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.076607:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736400.076610:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736400.076612:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790736400.078818:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790736400.078884:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb6323af/0x6aae200528fe751b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.078899:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1790736400.078910:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790736400.078916:0:15079:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb6323af/0x6aae200528fe751b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.078929:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb6323af/0x6aae200528fe751b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.078941:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb6323af/0x6aae200528fe751b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.078948:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb6323af/0x6aae200528fe751b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.078971:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790736400.079980:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790736400.079989:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096fc422c/0x6aae200528fe7522 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.080000:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1790736400.080003:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790736400.080007:0:15079:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096fc422c/0x6aae200528fe7522 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.080016:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096fc422c/0x6aae200528fe7522 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.080023:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096fc422c/0x6aae200528fe7522 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.080036:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096fc422c/0x6aae200528fe7522 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.080056:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790736400.080071:0:14385:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790736400.080077:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb6323af/0x6aae200528fe751b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.080084:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162156ec00 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:3.0:1790736400.080088:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb6323af/0x6aae200528fe751b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.080124:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb6323af/0x6aae200528fe751b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.080138:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb6323af/0x6aae200528fe751b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.080144:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb6323af/0x6aae200528fe751b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.080164:0:14385:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790736400.080168:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096fc422c/0x6aae200528fe7522 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.080187:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162156e800 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:3.0:1790736400.080190:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096fc422c/0x6aae200528fe7522 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.080197:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096fc422c/0x6aae200528fe7522 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.080207:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096fc422c/0x6aae200528fe7522 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.080214:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096fc422c/0x6aae200528fe7522 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.080227:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736400.080228:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736400.080230:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736400.080565:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790736400.084266:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790736400.084279:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f056cca2/0x6aae200528fe7529 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.084294:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=472s v=(0 0) 00010000:00010000:2.0:1790736400.084299:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790736400.084306:0:15079:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f056cca2/0x6aae200528fe7529 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.084318:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f056cca2/0x6aae200528fe7529 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.084327:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f056cca2/0x6aae200528fe7529 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.084334:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f056cca2/0x6aae200528fe7529 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.084354:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790736400.084779:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790736400.084784:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cfdc700/0x6aae200528fe7530 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.084814:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=472s v=(0 0) 00010000:00010000:2.0:1790736400.084817:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790736400.086058:0:14385:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790736400.086066:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f056cca2/0x6aae200528fe7529 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.086078:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163c527e00 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:3.0:1790736400.086083:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f056cca2/0x6aae200528fe7529 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.086108:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f056cca2/0x6aae200528fe7529 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.086140:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f056cca2/0x6aae200528fe7529 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.086147:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f056cca2/0x6aae200528fe7529 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.086164:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736400.086167:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736400.086168:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736400.087611:0:15079:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cfdc700/0x6aae200528fe7530 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.087638:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000cfdc700/0x6aae200528fe7530 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.087650:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cfdc700/0x6aae200528fe7530 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.087658:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000cfdc700/0x6aae200528fe7530 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.087689:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790736400.087723:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790736400.087731:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000cfdc700/0x6aae200528fe7530 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.087740:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163c526000 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:1.0:1790736400.087743:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000cfdc700/0x6aae200528fe7530 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.087752:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000cfdc700/0x6aae200528fe7530 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.087771:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000cfdc700/0x6aae200528fe7530 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.087778:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cfdc700/0x6aae200528fe7530 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.087802:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736400.087803:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736400.087805:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790736400.088296:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790736400.088303:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2f7b75a/0x6aae200528fe7537 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.088314:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=472s v=(0 0) 00010000:00010000:2.0:1790736400.088318:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790736400.088323:0:15079:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2f7b75a/0x6aae200528fe7537 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.088332:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2f7b75a/0x6aae200528fe7537 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.088352:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2f7b75a/0x6aae200528fe7537 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.088360:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2f7b75a/0x6aae200528fe7537 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.088377:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790736400.088400:0:14385:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790736400.088408:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2f7b75a/0x6aae200528fe7537 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.088417:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163c526200 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:3.0:1790736400.088421:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2f7b75a/0x6aae200528fe7537 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.088537:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2f7b75a/0x6aae200528fe7537 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.088551:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2f7b75a/0x6aae200528fe7537 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.088558:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2f7b75a/0x6aae200528fe7537 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.088600:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736400.088602:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736400.088604:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790736400.088779:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790736400.088785:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e37ba661/0x6aae200528fe753e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.088793:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=472s v=(0 0) 00010000:00010000:2.0:1790736400.088797:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790736400.088800:0:15079:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e37ba661/0x6aae200528fe753e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.088809:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e37ba661/0x6aae200528fe753e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.088816:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e37ba661/0x6aae200528fe753e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.088822:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e37ba661/0x6aae200528fe753e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.088853:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790736400.088890:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790736400.088905:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e37ba661/0x6aae200528fe753e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.088913:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163c527600 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:1.0:1790736400.088917:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e37ba661/0x6aae200528fe753e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.088924:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e37ba661/0x6aae200528fe753e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.088935:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e37ba661/0x6aae200528fe753e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.088941:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e37ba661/0x6aae200528fe753e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.088955:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736400.088958:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736400.088961:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790736400.089260:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790736400.089266:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000264d0181/0x6aae200528fe7545 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.089274:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=472s v=(0 0) 00010000:00010000:2.0:1790736400.089277:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790736400.089280:0:15079:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000264d0181/0x6aae200528fe7545 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.089288:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000264d0181/0x6aae200528fe7545 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.089296:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000264d0181/0x6aae200528fe7545 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.089302:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000264d0181/0x6aae200528fe7545 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.089316:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790736400.090043:0:14385:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790736400.090051:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000264d0181/0x6aae200528fe7545 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.090062:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163c526800 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:3.0:1790736400.090065:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000264d0181/0x6aae200528fe7545 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.090074:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000264d0181/0x6aae200528fe7545 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.090155:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000264d0181/0x6aae200528fe7545 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.090164:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000264d0181/0x6aae200528fe7545 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736400.090184:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736400.090186:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736400.090187:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790736400.092642:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790736400.092656:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e8a4503/0x6aae200528fe754c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.092672:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=472s v=(0 0) 00010000:00010000:2.0:1790736400.092683:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790736400.092690:0:15079:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e8a4503/0x6aae200528fe754c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.092704:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e8a4503/0x6aae200528fe754c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.092715:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e8a4503/0x6aae200528fe754c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.092723:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e8a4503/0x6aae200528fe754c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.092751:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790736400.092765:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790736400.092774:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e8a4503/0x6aae200528fe754c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.092784:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163c527200 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:1.0:1790736400.092790:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e8a4503/0x6aae200528fe754c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.092810:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e8a4503/0x6aae200528fe754c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.092832:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e8a4503/0x6aae200528fe754c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.092839:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e8a4503/0x6aae200528fe754c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.092859:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736400.092861:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736400.092863:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790736400.093594:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790736400.093602:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b046902/0x6aae200528fe7553 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.093613:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=472s v=(0 0) 00010000:00010000:2.0:1790736400.093617:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790736400.093622:0:15079:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b046902/0x6aae200528fe7553 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.093632:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b046902/0x6aae200528fe7553 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.093640:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b046902/0x6aae200528fe7553 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.093652:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b046902/0x6aae200528fe7553 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.093672:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790736400.093683:0:14385:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790736400.093688:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b046902/0x6aae200528fe7553 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.093695:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163c526c00 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:2.0:1790736400.093699:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b046902/0x6aae200528fe7553 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.093707:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b046902/0x6aae200528fe7553 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.093721:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b046902/0x6aae200528fe7553 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.093728:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b046902/0x6aae200528fe7553 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.093744:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736400.093746:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736400.093748:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790736400.101411:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790736400.101824:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a196d76d/0x6aae200528fe755a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.101842:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=472s v=(0 0) 00010000:00010000:2.0:1790736400.101847:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790736400.101854:0:15079:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a196d76d/0x6aae200528fe755a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.101867:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a196d76d/0x6aae200528fe755a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.101878:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a196d76d/0x6aae200528fe755a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.101887:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a196d76d/0x6aae200528fe755a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.101908:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790736400.101937:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790736400.101947:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a196d76d/0x6aae200528fe755a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.101958:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163c526400 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:1.0:1790736400.101963:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a196d76d/0x6aae200528fe755a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.101973:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a196d76d/0x6aae200528fe755a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.101990:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a196d76d/0x6aae200528fe755a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.102010:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a196d76d/0x6aae200528fe755a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.102033:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736400.102035:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736400.102037:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790736400.102492:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790736400.102499:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7e79115/0x6aae200528fe7561 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.102509:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=472s v=(0 0) 00010000:00010000:2.0:1790736400.102512:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790736400.102517:0:15079:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7e79115/0x6aae200528fe7561 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.102527:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7e79115/0x6aae200528fe7561 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.102553:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7e79115/0x6aae200528fe7561 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.102562:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7e79115/0x6aae200528fe7561 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.102590:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790736400.102601:0:14385:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790736400.102990:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7e79115/0x6aae200528fe7561 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.103001:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163c526e00 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:2.0:1790736400.103005:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7e79115/0x6aae200528fe7561 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.103013:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7e79115/0x6aae200528fe7561 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.103026:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7e79115/0x6aae200528fe7561 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.103034:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7e79115/0x6aae200528fe7561 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.103050:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736400.103058:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736400.103060:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790736400.104015:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790736400.104025:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000714f221a/0x6aae200528fe7568 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.104036:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=472s v=(0 0) 00010000:00010000:2.0:1790736400.104040:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790736400.104044:0:15079:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000714f221a/0x6aae200528fe7568 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.104055:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000714f221a/0x6aae200528fe7568 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.104064:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000714f221a/0x6aae200528fe7568 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.104073:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000714f221a/0x6aae200528fe7568 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.104089:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790736400.105042:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790736400.105052:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000671b3457/0x6aae200528fe756f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.105065:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=472s v=(0 0) 00010000:00010000:2.0:1790736400.105069:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790736400.105074:0:15079:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000671b3457/0x6aae200528fe756f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.105116:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000671b3457/0x6aae200528fe756f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.105127:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000671b3457/0x6aae200528fe756f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.105134:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000671b3457/0x6aae200528fe756f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.105151:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790736400.105157:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790736400.105163:0:14385:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790736400.105165:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000714f221a/0x6aae200528fe7568 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.105177:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163c527400 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:1.0:1790736400.105181:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000714f221a/0x6aae200528fe7568 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.105191:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000714f221a/0x6aae200528fe7568 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.105208:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000714f221a/0x6aae200528fe7568 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.105215:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000714f221a/0x6aae200528fe7568 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.105236:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736400.105238:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736400.105240:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790736400.105832:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790736400.105838:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cad8e10/0x6aae200528fe7576 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.105845:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=472s v=(0 0) 00010000:00010000:2.0:1790736400.105848:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790736400.105851:0:15079:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cad8e10/0x6aae200528fe7576 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.105857:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cad8e10/0x6aae200528fe7576 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.105862:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cad8e10/0x6aae200528fe7576 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.105875:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002cad8e10/0x6aae200528fe7576 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.105890:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790736400.106223:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790736400.106229:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000712807a8/0x6aae200528fe757d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.106237:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=472s v=(0 0) 00010000:00010000:2.0:1790736400.106240:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790736400.106244:0:15079:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000712807a8/0x6aae200528fe757d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.106253:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000712807a8/0x6aae200528fe757d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.106261:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000712807a8/0x6aae200528fe757d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.106267:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000712807a8/0x6aae200528fe757d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.106276:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1790736400.106677:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790736400.106684:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000195aa328/0x6aae200528fe7584 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.106697:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=472s v=(0 0) 00010000:00010000:2.0:1790736400.106701:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790736400.106707:0:15079:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000195aa328/0x6aae200528fe7584 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.106717:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000195aa328/0x6aae200528fe7584 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.106726:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000195aa328/0x6aae200528fe7584 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.106728:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790736400.106737:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000195aa328/0x6aae200528fe7584 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.106738:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002cad8e10/0x6aae200528fe7576 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.106761:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163c527000 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:2.0:1790736400.106762:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790736400.106770:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002cad8e10/0x6aae200528fe7576 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.106780:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002cad8e10/0x6aae200528fe7576 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.106796:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002cad8e10/0x6aae200528fe7576 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.106804:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cad8e10/0x6aae200528fe7576 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.106829:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790736400.106833:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000712807a8/0x6aae200528fe757d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.106841:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163c527800 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:1.0:1790736400.106845:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000712807a8/0x6aae200528fe757d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.106853:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000712807a8/0x6aae200528fe757d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.106879:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000712807a8/0x6aae200528fe757d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.106887:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000712807a8/0x6aae200528fe757d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.106905:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790736400.106909:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000195aa328/0x6aae200528fe7584 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.106917:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941611930600 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:1.0:1790736400.106920:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000195aa328/0x6aae200528fe7584 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.106929:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000195aa328/0x6aae200528fe7584 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.106940:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000195aa328/0x6aae200528fe7584 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.106947:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000195aa328/0x6aae200528fe7584 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736400.106961:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736400.106963:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736400.106971:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790736400.107197:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790736400.107204:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4e6f428/0x6aae200528fe758b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.107212:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=472s v=(0 0) 00010000:00010000:2.0:1790736400.107215:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790736400.107220:0:15079:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4e6f428/0x6aae200528fe758b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.107229:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4e6f428/0x6aae200528fe758b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.107248:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4e6f428/0x6aae200528fe758b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.107256:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4e6f428/0x6aae200528fe758b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.107786:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790736400.108247:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790736400.108255:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b58ea500/0x6aae200528fe7592 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.108266:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=472s v=(0 0) 00010000:00010000:2.0:1790736400.108269:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790736400.108273:0:15079:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b58ea500/0x6aae200528fe7592 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.108283:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b58ea500/0x6aae200528fe7592 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.108291:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b58ea500/0x6aae200528fe7592 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.108299:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b58ea500/0x6aae200528fe7592 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.115772:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1790736400.116384:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790736400.116395:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050917cd8/0x6aae200528fe7599 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.116412:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=472s v=(0 0) 00010000:00010000:2.0:1790736400.116416:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790736400.116423:0:15079:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050917cd8/0x6aae200528fe7599 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.118552:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050917cd8/0x6aae200528fe7599 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.118577:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050917cd8/0x6aae200528fe7599 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.118586:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050917cd8/0x6aae200528fe7599 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.118602:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00080000:2.0:1790736400.119000:0:15079:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:2.0:1790736400.119115:0:15079:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14421:x1877722816155648:12345-0@lo:5:osp-pre-1-0.0 Request processed in 91210us (91504us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736400.119124:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1790736400.119204:0:16095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790736400.119216:0:16095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4e6f428/0x6aae200528fe758b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.119225:0:16095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941611931200 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:2.0:1790736400.119229:0:16095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4e6f428/0x6aae200528fe758b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.119240:0:16095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4e6f428/0x6aae200528fe758b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.119258:0:16095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4e6f428/0x6aae200528fe758b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.119265:0:16095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4e6f428/0x6aae200528fe758b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.119288:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000671b3457/0x6aae200528fe756f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.119294:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163c526a00 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:2.0:1790736400.119297:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000671b3457/0x6aae200528fe756f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.119305:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000671b3457/0x6aae200528fe756f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.119313:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000671b3457/0x6aae200528fe756f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.119327:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000671b3457/0x6aae200528fe756f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.119343:0:14385:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790736400.119347:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b58ea500/0x6aae200528fe7592 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.119353:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941611930e00 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:2.0:1790736400.119355:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b58ea500/0x6aae200528fe7592 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.119363:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b58ea500/0x6aae200528fe7592 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.119373:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b58ea500/0x6aae200528fe7592 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.119379:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b58ea500/0x6aae200528fe7592 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.119389:0:14385:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790736400.119392:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050917cd8/0x6aae200528fe7599 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.119398:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941611930200 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:2.0:1790736400.119407:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050917cd8/0x6aae200528fe7599 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.119414:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050917cd8/0x6aae200528fe7599 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.119423:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050917cd8/0x6aae200528fe7599 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.119431:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050917cd8/0x6aae200528fe7599 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736400.119444:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736400.119446:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736400.119447:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736400.119452:0:16095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736400.119453:0:16095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790736400.119455:0:16095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736400.123090:0:14421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633803100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14421:1877722816155648:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1790736400.123130:0:14421:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:3.0:1790736400.123194:0:14421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633803100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14421:1877722816155776:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1790736400.123254:0:14421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736400.123297:0:14421:0:(client.c:2716:ptlrpc_set_wait()) set ffff94162f219180 going to sleep for 11 seconds 00000100:00100000:3.0:1790736400.123316:0:15807:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816155776 00000100:00100000:3.0:1790736400.123322:0:15807:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816155776 00000100:00100000:3.0:1790736400.123363:0:15807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790736400.123371:0:15807:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14421:x1877722816155776:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1790736400.123418:0:15807:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:1.0:1790736400.125126:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736400.125146:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1790736400.128976:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1790736400.136159:0:15807:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:14421:x1877722816155776:12345-0@lo:5:osp-pre-1-0.0 Request processed in 12782us (12898us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1790736400.136173:0:15807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790736400.136194:0:14421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633803100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14421:1877722816155776:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1790736400.136211:0:14421:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:3.0:1790736400.471261:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790736401.046282:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633800e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816155904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790736401.046348:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736401.049873:0:15082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816155904 00000100:00100000:0.0:1790736401.049887:0:15082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816155904 00000100:00100000:0.0:1790736401.049948:0:15082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790736401.051760:0:15082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816155904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790736401.051803:0:15082:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790736401.051899:0:15082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816155904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1943us (5550us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736401.051910:0:15082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790736401.052085:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633800e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816155904:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1790736401.076002:0:16155:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg305-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790736401.495713:0:16095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736402.517770:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790736403.471274:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736403.472858:0:14391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797285120 00000100:00100000:0.0:1790736403.472873:0:14391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797285120 00000100:00100000:0.0:1790736403.472934:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 75 00000100:00100000:0.0:1790736403.472943:0:14391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162e4e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2352:x1877722797285120:12345-192.168.203.5@tcp:250:mount.lustre.0 00010000:00080000:0.0:1790736403.472971:0:14391:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 21106d43-d924-4418-90ae-b5795be7a32c@192.168.203.5@tcp t0 exp 0000000000000000 cur 475 last 0 00000020:00000080:0.0:1790736403.473005:0:14391:0:(genops.c:1384:class_connect()) connect: client 21106d43-d924-4418-90ae-b5795be7a32c, cookie 0x6aae200528fe75a0 00000100:00080000:2.0:1790736403.473261:0:14391:0:(import.c:65:import_set_state_nolock()) ffff94162e530800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790736403.473345:0:14391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162e4e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21106d43-d924-4418-90ae-b5795be7a32c+5:2352:x1877722797285120:12345-192.168.203.5@tcp:250:mount.lustre.0 Request processed in 400us (2080us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736403.473354:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 75 00000100:00100000:1.0:1790736403.479572:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736403.479680:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797285248 00000100:00100000:0.0:1790736403.479690:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797285248 00000100:00100000:0.0:1790736403.479752:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 76 00000100:00100000:0.0:1790736403.479762:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162e4e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21106d43-d924-4418-90ae-b5795be7a32c+5:13713:x1877722797285248:12345-192.168.203.5@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790736403.479792:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736403.479809:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94163be29000/0x6aae200528fe75a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x92962417a527153 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736403.479838:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94163be29000/0x6aae200528fe75a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527153 expref: 6 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736403.479849:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94163be29000/0x6aae200528fe75a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527153 expref: 6 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736403.479857:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94163be29000, rc 0) 00000100:00100000:0.0:1790736403.479915:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162e4e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21106d43-d924-4418-90ae-b5795be7a32c+6:13713:x1877722797285248:12345-192.168.203.5@tcp:101:mount.lustre.0 Request processed in 155us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736403.479921:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 76 00000100:00100000:0.0:1790736403.491496:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736403.491851:0:14391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797285376 00000100:00100000:2.0:1790736403.491862:0:14391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797285376 00000100:00100000:2.0:1790736403.491917:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 77 00000100:00100000:2.0:1790736403.491927:0:14391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162e4e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21106d43-d924-4418-90ae-b5795be7a32c+6:13713:x1877722797285376:12345-192.168.203.5@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790736403.492327:0:14391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162e4e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21106d43-d924-4418-90ae-b5795be7a32c+6:13713:x1877722797285376:12345-192.168.203.5@tcp:501:mount.lustre.0 Request processed in 401us (839us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790736403.492343:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 77 00000100:00100000:2.0:1790736403.499207:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736403.499312:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797285504 00000100:00100000:1.0:1790736403.499323:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797285504 00000100:00100000:1.0:1790736403.499379:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 78 00000100:00100000:1.0:1790736403.499389:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162e4e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21106d43-d924-4418-90ae-b5795be7a32c+6:13713:x1877722797285504:12345-192.168.203.5@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790736403.499407:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736403.499424:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941633c60e00/0x6aae200528fe75ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x92962417a52715a expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736403.499452:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941633c60e00/0x6aae200528fe75ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52715a expref: 7 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736403.499464:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941633c60e00/0x6aae200528fe75ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52715a expref: 7 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736403.499473:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c60e00, rc 0) 00000100:00100000:1.0:1790736403.499532:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162e4e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21106d43-d924-4418-90ae-b5795be7a32c+7:13713:x1877722797285504:12345-192.168.203.5@tcp:101:mount.lustre.0 Request processed in 144us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736403.499570:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 78 00000100:00100000:1.0:1790736403.507415:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736403.507609:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797285632 00000100:00100000:0.0:1790736403.507621:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797285632 00000100:00100000:0.0:1790736403.507677:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 79 00000100:00100000:0.0:1790736403.507687:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162e4e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21106d43-d924-4418-90ae-b5795be7a32c+7:13713:x1877722797285632:12345-192.168.203.5@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790736403.508016:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162e4e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21106d43-d924-4418-90ae-b5795be7a32c+8:13713:x1877722797285632:12345-192.168.203.5@tcp:501:mount.lustre.0 Request processed in 319us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736403.508023:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 79 00000100:00100000:0.0:1790736403.514036:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736403.514195:0:14391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797285760 00000100:00100000:2.0:1790736403.514206:0:14391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797285760 00000100:00100000:2.0:1790736403.514264:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 80 00000100:00100000:2.0:1790736403.514274:0:14391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941615e69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21106d43-d924-4418-90ae-b5795be7a32c+8:13713:x1877722797285760:12345-192.168.203.5@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790736403.514608:0:14391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941615e69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21106d43-d924-4418-90ae-b5795be7a32c+8:13713:x1877722797285760:12345-192.168.203.5@tcp:503:mount.lustre.0 Request processed in 334us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736403.514615:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 80 00000100:00100000:2.0:1790736403.521311:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736403.521448:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797285888 00000100:00100000:1.0:1790736403.521458:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797285888 00000100:00100000:1.0:1790736403.521513:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 81 00000100:00100000:1.0:1790736403.521523:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21106d43-d924-4418-90ae-b5795be7a32c+8:13732:x1877722797285888:12345-192.168.203.5@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790736403.522289:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21106d43-d924-4418-90ae-b5795be7a32c+8:13732:x1877722797285888:12345-192.168.203.5@tcp:502:llog_process_th.0 Request processed in 763us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736403.522299:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 81 00010000:00010000:3.0:1790736403.541336:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736403.548711:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736403.549947:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797286016 00000100:00100000:0.0:1790736403.549959:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797286016 00000100:00100000:1.0:1790736403.560585:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 82 00000100:00100000:1.0:1790736403.560600:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21106d43-d924-4418-90ae-b5795be7a32c+8:13732:x1877722797286016:12345-192.168.203.5@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790736403.561778:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21106d43-d924-4418-90ae-b5795be7a32c+8:13732:x1877722797286016:12345-192.168.203.5@tcp:502:llog_process_th.0 Request processed in 1174us (13068us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736403.561789:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 82 00000100:00100000:0.0:1790736403.567379:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736403.567659:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797286144 00000100:00100000:1.0:1790736403.567671:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797286144 00000100:00100000:1.0:1790736403.567805:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 83 00000100:00100000:1.0:1790736403.567819:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21106d43-d924-4418-90ae-b5795be7a32c+8:13713:x1877722797286144:12345-192.168.203.5@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790736403.567839:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736403.567932:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941633c61600/0x6aae200528fe75b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x92962417a527184 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736403.567968:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941633c61600/0x6aae200528fe75b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527184 expref: 9 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736403.567999:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941633c61600/0x6aae200528fe75b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527184 expref: 9 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736403.568020:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c61600, rc 0) 00000100:00100000:1.0:1790736403.568517:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21106d43-d924-4418-90ae-b5795be7a32c+9:13713:x1877722797286144:12345-192.168.203.5@tcp:101:mount.lustre.0 Request processed in 699us (1144us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736403.568526:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 83 00000100:00100000:2.0:1790736403.574488:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736403.574607:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797286272 00000100:00100000:1.0:1790736403.574618:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797286272 00000100:00100000:1.0:1790736403.574680:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 84 00000100:00100000:1.0:1790736403.574691:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21106d43-d924-4418-90ae-b5795be7a32c+9:13713:x1877722797286272:12345-192.168.203.5@tcp:256:mount.lustre.0 20000000:01000000:1.0:1790736403.574716:0:14389:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1790736403.574868:0:14389:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1790736403.574873:0:14389:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1790736403.574876:0:14389:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1790736403.574878:0:14389:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1790736403.577353:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21106d43-d924-4418-90ae-b5795be7a32c+9:13713:x1877722797286272:12345-192.168.203.5@tcp:256:mount.lustre.0 Request processed in 2654us (2865us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736403.577367:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 84 00000100:00100000:0.0:1790736403.582027:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736403.582218:0:14391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797286400 00000100:00100000:2.0:1790736403.582228:0:14391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797286400 00000100:00100000:2.0:1790736403.582285:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 85 00000100:00100000:2.0:1790736403.582294:0:14391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21106d43-d924-4418-90ae-b5795be7a32c+9:13713:x1877722797286400:12345-192.168.203.5@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790736403.582325:0:14391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736403.582353:0:14391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941611931600/0x6aae200528fe75bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x92962417a52718b expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736403.582398:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941611931600/0x6aae200528fe75bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52718b expref: 10 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736403.582425:0:14391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941611931600/0x6aae200528fe75bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52718b expref: 10 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736403.582438:0:14391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611931600, rc 0) 00000100:00100000:2.0:1790736403.582531:0:14391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21106d43-d924-4418-90ae-b5795be7a32c+10:13713:x1877722797286400:12345-192.168.203.5@tcp:101:mount.lustre.0 Request processed in 234us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736403.582541:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 85 00000100:00100000:2.0:1790736403.585529:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736403.586225:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797286528 00000100:00100000:1.0:1790736403.586237:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797286528 00000100:00100000:0.0:1790736403.586908:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 86 00000100:00100000:0.0:1790736403.586922:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21106d43-d924-4418-90ae-b5795be7a32c+10:13713:x1877722797286528:12345-192.168.203.5@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790736403.587277:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21106d43-d924-4418-90ae-b5795be7a32c+10:13713:x1877722797286528:12345-192.168.203.5@tcp:501:mount.lustre.0 Request processed in 358us (1756us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736403.587286:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 86 00000100:00100000:1.0:1790736403.589526:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736403.589619:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797286656 00000100:00100000:3.0:1790736403.589638:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797286656 00000100:00100000:3.0:1790736403.590450:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 87 00000100:00100000:3.0:1790736403.590468:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21106d43-d924-4418-90ae-b5795be7a32c+10:13713:x1877722797286656:12345-192.168.203.5@tcp:503:mount.lustre.0 00000100:00100000:3.0:1790736403.591038:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21106d43-d924-4418-90ae-b5795be7a32c+10:13713:x1877722797286656:12345-192.168.203.5@tcp:503:mount.lustre.0 Request processed in 564us (1510us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736403.591049:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 87 00000100:00100000:1.0:1790736403.599769:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736403.599967:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797286784 00000100:00100000:0.0:1790736403.599986:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797286784 00000100:00100000:0.0:1790736403.600074:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 88 00000100:00100000:0.0:1790736403.600085:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21106d43-d924-4418-90ae-b5795be7a32c+10:13735:x1877722797286784:12345-192.168.203.5@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790736403.605905:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21106d43-d924-4418-90ae-b5795be7a32c+10:13735:x1877722797286784:12345-192.168.203.5@tcp:502:llog_process_th.0 Request processed in 5804us (6128us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736403.605924:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 88 00000100:00100000:0.0:1790736403.618630:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736403.619037:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797286912 00000100:00100000:3.0:1790736403.619053:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797286912 00000100:00100000:3.0:1790736403.619192:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 89 00000100:00100000:2.0:1790736403.619342:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21106d43-d924-4418-90ae-b5795be7a32c+10:13735:x1877722797286912:12345-192.168.203.5@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790736403.619763:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21106d43-d924-4418-90ae-b5795be7a32c+10:13735:x1877722797286912:12345-192.168.203.5@tcp:502:llog_process_th.0 Request processed in 559us (1147us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736403.619773:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 89 00000100:00100000:1.0:1790736403.633343:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736403.634163:0:14398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797287040 00000100:00100000:2.0:1790736403.634180:0:14398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797287040 00000100:00100000:2.0:1790736403.634253:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 4 00000100:00100000:2.0:1790736403.634265:0:14398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2352:x1877722797287040:12345-192.168.203.5@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790736403.634309:0:14398:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 8fa9af14-c6db-4fd8-ba33-7fb937b5df25@192.168.203.5@tcp t0 exp 0000000000000000 cur 475 last 0 00000020:00000080:2.0:1790736403.634385:0:14398:0:(genops.c:1384:class_connect()) connect: client 8fa9af14-c6db-4fd8-ba33-7fb937b5df25, cookie 0x6aae200528fe75c3 00000004:00100000:2.0:1790736403.634428:0:14398:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1790736403.634435:0:14398:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1790736403.681924:0:14398:0:(import.c:65:import_set_state_nolock()) ffff941637f63000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790736403.682204:0:14398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+6:2352:x1877722797287040:12345-192.168.203.5@tcp:38:mount.lustre.0 Request processed in 47937us (48875us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736403.682218:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 4 00000100:00100000:1.0:1790736403.692478:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736403.692568:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736403.692736:0:14396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797287168 00000100:00100000:0.0:1790736403.692750:0:14396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797287168 00000100:00100000:0.0:1790736403.692846:0:14396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797287296 00000100:00100000:0.0:1790736403.692850:0:14396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797287296 00000100:00100000:0.0:1790736403.692873:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 5 00000100:00100000:0.0:1790736403.692885:0:14396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+7:0:x1877722797287168:12345-192.168.203.5@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790736403.692950:0:14396:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790736403.693078:0:14396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+7:0:x1877722797287168:12345-192.168.203.5@tcp:41:mount.lustre.0 Request processed in 196us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736403.693088:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 5 00000100:00100000:0.0:1790736403.693149:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6 00000100:00100000:0.0:1790736403.693155:0:14396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+6:13713:x1877722797287296:12345-192.168.203.5@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790736403.693186:0:14396:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790736403.693211:0:14396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+6:13713:x1877722797287296:12345-192.168.203.5@tcp:41:mount.lustre.0 Request processed in 56us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736403.693218:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6 00000100:00080000:3.0:1790736403.693470:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790736403.695839:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736403.695944:0:14396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797287424 00000100:00100000:2.0:1790736403.695958:0:14396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797287424 00000100:00100000:2.0:1790736403.696138:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 7 00000100:00100000:2.0:1790736403.696149:0:14396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+6:13713:x1877722797287424:12345-192.168.203.5@tcp:40:mount.lustre.0 00000100:00100000:2.0:1790736403.696340:0:14396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+6:13713:x1877722797287424:12345-192.168.203.5@tcp:40:mount.lustre.0 Request processed in 192us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736403.696367:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 7 00000100:00100000:1.0:1790736403.699395:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736403.699540:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736403.699586:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736403.700203:0:15079:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797287552 00000100:00100000:3.0:1790736403.700219:0:15079:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797287552 00000100:00100000:3.0:1790736403.700285:0:15079:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797287680 00000100:00100000:3.0:1790736403.700300:0:15079:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797287680 00000100:00100000:3.0:1790736403.700331:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 8 00000100:00100000:3.0:1790736403.700341:0:15079:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642041880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1877722797287552:12345-192.168.203.5@tcp:8:mount.lustre.0 00010000:00080000:3.0:1790736403.700383:0:15079:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 8fa9af14-c6db-4fd8-ba33-7fb937b5df25@192.168.203.5@tcp t0 exp 0000000000000000 cur 475 last 0 00000020:00000080:3.0:1790736403.700421:0:15079:0:(genops.c:1384:class_connect()) connect: client 8fa9af14-c6db-4fd8-ba33-7fb937b5df25, cookie 0x6aae200528fe75ca 00002000:00100000:3.0:1790736403.700435:0:15079:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8fa9af14-c6db-4fd8-ba33-7fb937b5df25/ffff94161816c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790736403.700468:0:15079:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790736403.700940:0:15079:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790736403.701326:0:15079:0:(import.c:65:import_set_state_nolock()) ffff94161816b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790736403.701722:0:15079:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642041880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+6:2352:x1877722797287552:12345-192.168.203.5@tcp:8:mount.lustre.0 Request processed in 1376us (2177us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736403.701733:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 8 00000100:00100000:3.0:1790736403.701767:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 9 00000100:00100000:3.0:1790736403.701774:0:15079:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1877722797287680:12345-192.168.203.5@tcp:8:mount.lustre.0 00010000:00080000:3.0:1790736403.701799:0:15079:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 8fa9af14-c6db-4fd8-ba33-7fb937b5df25@192.168.203.5@tcp t0 exp 0000000000000000 cur 475 last 0 00000020:00000080:3.0:1790736403.701827:0:15079:0:(genops.c:1384:class_connect()) connect: client 8fa9af14-c6db-4fd8-ba33-7fb937b5df25, cookie 0x6aae200528fe75d1 00002000:00100000:3.0:1790736403.701838:0:15079:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8fa9af14-c6db-4fd8-ba33-7fb937b5df25/ffff94161816e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790736403.701860:0:15079:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790736403.702621:0:15079:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790736403.702659:0:15079:0:(import.c:65:import_set_state_nolock()) ffff94161816a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790736403.702716:0:15079:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+6:2352:x1877722797287680:12345-192.168.203.5@tcp:8:mount.lustre.0 Request processed in 940us (3127us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736403.702724:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 9 00000100:00100000:1.0:1790736403.704391:0:14399:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797287808 00000100:00100000:1.0:1790736403.704423:0:14399:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797287808 00000100:00100000:2.0:1790736403.704680:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 0 00000100:00100000:2.0:1790736403.704694:0:14400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+6:13713:x1877722797287808:12345-192.168.203.5@tcp:33:mount.lustre.0 00000100:00100000:1.0:1790736403.705150:0:14399:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:1.0:1790736403.705161:0:14399:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000004:00080000:2.0:1790736403.717316:0:14400:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 12502us 00000004:00200000:2.0:1790736403.756980:0:14400:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1790736403.757190:0:14400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+6:13713:x1877722797287808:12345-192.168.203.5@tcp:33:mount.lustre.0 Request processed in 52491us (57802us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736403.757205:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 0 00000100:00100000:1.0:1790736403.993015:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736403.993204:0:14398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797287936 00000100:00100000:2.0:1790736403.993218:0:14398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797287936 00000100:00100000:2.0:1790736403.993312:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 8 00000100:00100000:2.0:1790736403.993329:0:14398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+6:13756:x1877722797287936:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:2.0:1790736403.993362:0:14398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736403.993398:0:14398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931800/0x6aae200528fe75d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a5271b5 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736403.993504:0:14398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe75df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736403.993522:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe75df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736403.993549:0:14398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe75df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790736403.993607:0:14398:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790736403.993612:0:14398:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790736403.993683:0:14398:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe75df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736403.993717:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931800/0x6aae200528fe75d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5271b5 expref: 8 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736403.993741:0:14398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe75df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5271b5 expref: 7 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736403.993751:0:14398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff941605242100) 00010000:00010000:2.0:1790736403.993754:0:14398:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790736403.993757:0:14398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611931c00, rc 0) 00000100:00100000:2.0:1790736403.993847:0:14398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+7:13756:x1877722797287936:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 525us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736403.993855:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 8 00010000:00010000:0.0:1790736404.567817:0:16095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736405.141969:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816156160:0@lo:400:kworker.0 00000100:00100000:3.0:1790736405.142118:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736405.142197:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1877722816156672:0@lo:400:kworker.0 00000100:00100000:3.0:1790736405.142226:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736405.142227:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633800e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816156288:0@lo:400:kworker.0 00000100:00100000:0.0:1790736405.142261:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736405.142279:0:15078:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816156160 00000100:00100000:0.0:1790736405.142281:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163fae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816156800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790736405.142289:0:15078:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816156160 00000100:00100000:0.0:1790736405.142303:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736405.142334:0:14397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816156672 00000100:00100000:0.0:1790736405.142338:0:14397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816156672 00000100:00100000:3.0:1790736405.142351:0:15078:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816156288 00000100:00100000:3.0:1790736405.142354:0:15078:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816156288 00000100:00100000:0.0:1790736405.142371:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790736405.142373:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790736405.142383:0:15078:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816156160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736405.142383:0:14397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877722816156672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736405.142440:0:15078:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816156160:12345-0@lo:400:kworker.0 Request processed in 60us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736405.142448:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790736405.142480:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790736405.142486:0:15078:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1877722816156288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736405.142515:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633800380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd61a3fa-9892-475c-9015-fd1ddc473c5e:3309:1877722816156032:0@lo:400:kworker.0 00000100:00100000:3.0:1790736405.142519:0:15078:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1877722816156288:12345-0@lo:400:kworker.0 Request processed in 34us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736405.142524:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790736405.142556:0:15083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816156800 00000100:00100000:3.0:1790736405.142560:0:15083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816156800 00000100:00100000:1.0:1790736405.142567:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736405.142582:0:15083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790736405.142588:0:15083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1877722816156800:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790736405.142592:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1877722816156544:0@lo:400:kworker.0 00000100:00100000:1.0:1790736405.142614:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1790736405.142622:0:15083:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790736405.142633:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790736405.142638:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633803480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877722816156416:0@lo:400:kworker.0 00000100:00100000:3.0:1790736405.142655:0:15083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1877722816156800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736405.142658:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736405.142662:0:15083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1790736405.142678:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790736405.142683:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790736405.142694:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790736405.142776:0:14398:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1790736405.142787:0:14398:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1790736405.142918:0:14398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816156544 00000100:00100000:2.0:1790736405.142922:0:14398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816156544 00000100:00100000:2.0:1790736405.142943:0:14398:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1790736405.142951:0:14398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816156416 00000100:00100000:2.0:1790736405.142953:0:14398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816156416 00000100:00100000:2.0:1790736405.142961:0:14398:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1790736405.142967:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790736405.142973:0:14398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877722816156544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736405.143015:0:14398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877722816156544:12345-0@lo:400:kworker.0 Request processed in 42us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736405.143020:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790736405.143030:0:14398:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1790736405.143035:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790736405.143046:0:14398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642043100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877722816156416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736405.143070:0:14398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642043100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877722816156416:12345-0@lo:400:kworker.0 Request processed in 24us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736405.143075:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790736405.143143:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816156032 00000100:00100000:2.0:1790736405.143147:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816156032 00000100:00100000:2.0:1790736405.143171:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1790736405.143177:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+19:3309:x1877722816156032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736405.143205:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+19:3309:x1877722816156032:12345-0@lo:400:kworker.0 Request processed in 28us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736405.143211:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1790736405.143257:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633800e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816156288:0@lo:400:kworker.0 00000100:00100000:2.0:1790736405.143273:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163fae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816156800:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1790736405.143430:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790736405.143474:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633803480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877722816156416:0@lo:400:kworker.0 00000100:00100000:2.0:1790736405.143483:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633800380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd61a3fa-9892-475c-9015-fd1ddc473c5e:3309:1877722816156032:0@lo:400:kworker.0 00000100:00100000:2.0:1790736405.143493:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1877722816156544:0@lo:400:kworker.0 00000100:00100000:0.0:1790736405.149978:0:14397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877722816156672:12345-0@lo:400:kworker.0 Request processed in 7581us (7733us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736405.149998:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790736405.151161:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816156160:0@lo:400:kworker.0 00000100:00100000:3.0:1790736405.151365:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1877722816156672:0@lo:400:kworker.0 00000001:00100000:3.0:1790736405.268738:0:7658:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1790736405.268790:0:7658:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8fa9af14-c6db-4fd8-ba33-7fb937b5df25 00000001:00080000:3.0:1790736405.268800:0:7658:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1790736405.271594:0:6725:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8fa9af14-c6db-4fd8-ba33-7fb937b5df25 00010000:00010000:1.0:1790736405.589797:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790736406.165953:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816156928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790736406.166054:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736406.166230:0:15083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816156928 00000100:00100000:0.0:1790736406.166242:0:15083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816156928 00000100:00100000:0.0:1790736406.166308:0:15083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790736406.166319:0:15083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816156928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790736406.166373:0:15083:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790736406.166786:0:15083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816156928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 467us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736406.166796:0:15083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790736406.170053:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816156928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790736406.229606:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736406.229750:0:14398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797288064 00000100:00100000:2.0:1790736406.229763:0:14398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797288064 00000100:00100000:2.0:1790736406.229868:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 9 00000100:00080000:3.0:1790736406.229869:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790736406.229888:0:14398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+7:13808:x1877722797288064:12345-192.168.203.5@tcp:41:lfs.0 00000004:00000024:2.0:1790736406.229961:0:14398:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790736406.230081:0:14398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+7:13808:x1877722797288064:12345-192.168.203.5@tcp:41:lfs.0 Request processed in 201us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736406.230090:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 9 00000100:00100000:3.0:1790736406.235761:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736406.236583:0:15082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797288192 00000100:00100000:1.0:1790736406.236601:0:15082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797288192 00000100:00100000:1.0:1790736406.236707:0:15082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6 00000100:00100000:1.0:1790736406.236721:0:15082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b782d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+5:13808:x1877722797288192:12345-192.168.203.5@tcp:13:lfs.0 00002000:00000024:1.0:1790736406.236767:0:15082:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790736406.236894:0:15082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b782d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+5:13808:x1877722797288192:12345-192.168.203.5@tcp:13:lfs.0 Request processed in 175us (1148us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736406.236902:0:15082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6 00000100:00080000:3.0:1790736406.237493:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790736406.243154:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736406.243773:0:15082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797288320 00000100:00100000:2.0:1790736406.243789:0:15082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797288320 00000100:00100000:2.0:1790736406.243892:0:15082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 7 00000100:00100000:2.0:1790736406.243905:0:15082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+5:13808:x1877722797288320:12345-192.168.203.5@tcp:13:lfs.0 00002000:00000024:2.0:1790736406.243941:0:15082:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790736406.244061:0:15082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+5:13808:x1877722797288320:12345-192.168.203.5@tcp:13:lfs.0 Request processed in 159us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736406.244070:0:15082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 7 00000100:00080000:3.0:1790736406.248927:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790736406.474917:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736406.484837:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797288448 00000100:00100000:1.0:1790736406.484872:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797288448 00000100:00100000:1.0:1790736406.485077:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 91 00000100:00100000:1.0:1790736406.485091:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21106d43-d924-4418-90ae-b5795be7a32c+10:13839:x1877722797288448:12345-192.168.203.5@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790736406.485719:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736406.485823:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941633c60200/0x6aae200528fe75e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x92962417a5271bc expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736406.485870:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941633c60200/0x6aae200528fe75e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5271bc expref: 11 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736406.485882:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941633c60200/0x6aae200528fe75e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5271bc expref: 11 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736406.485894:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c60200, rc 0) 00000100:00100000:1.0:1790736406.486040:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21106d43-d924-4418-90ae-b5795be7a32c+11:13839:x1877722797288448:12345-192.168.203.5@tcp:101:mount.lustre.0 Request processed in 951us (11139us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736406.486049:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 91 00000100:00100000:1.0:1790736406.499493:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736406.500149:0:14391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797288576 00000100:00100000:2.0:1790736406.500165:0:14391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797288576 00000100:00100000:2.0:1790736406.500248:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 92 00000100:00100000:2.0:1790736406.500259:0:14391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21106d43-d924-4418-90ae-b5795be7a32c+11:13839:x1877722797288576:12345-192.168.203.5@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790736406.500975:0:14391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21106d43-d924-4418-90ae-b5795be7a32c+11:13839:x1877722797288576:12345-192.168.203.5@tcp:501:mount.lustre.0 Request processed in 713us (1493us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736406.500986:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 92 00000100:00100000:2.0:1790736406.508232:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736406.508359:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797288704 00000100:00100000:1.0:1790736406.508375:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797288704 00000100:00100000:1.0:1790736406.508460:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 93 00000100:00100000:1.0:1790736406.508472:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21106d43-d924-4418-90ae-b5795be7a32c+11:13839:x1877722797288704:12345-192.168.203.5@tcp:503:mount.lustre.0 00000100:00100000:1.0:1790736406.510146:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21106d43-d924-4418-90ae-b5795be7a32c+11:13839:x1877722797288704:12345-192.168.203.5@tcp:503:mount.lustre.0 Request processed in 1609us (1862us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736406.510166:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 93 00000100:00100000:3.0:1790736406.534127:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736406.545853:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797288832 00000100:00100000:0.0:1790736406.545879:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797288832 00000100:00100000:0.0:1790736406.545987:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 94 00000100:00100000:0.0:1790736406.546002:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21106d43-d924-4418-90ae-b5795be7a32c+11:13846:x1877722797288832:12345-192.168.203.5@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790736406.552007:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21106d43-d924-4418-90ae-b5795be7a32c+11:13846:x1877722797288832:12345-192.168.203.5@tcp:502:llog_process_th.0 Request processed in 5975us (17876us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736406.552027:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 94 00000100:00100000:3.0:1790736406.578469:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736406.578906:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797288960 00000100:00100000:1.0:1790736406.578921:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797288960 00000100:00100000:1.0:1790736406.579005:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 95 00000100:00100000:1.0:1790736406.579017:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21106d43-d924-4418-90ae-b5795be7a32c+11:13846:x1877722797288960:12345-192.168.203.5@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790736406.579924:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21106d43-d924-4418-90ae-b5795be7a32c+11:13846:x1877722797288960:12345-192.168.203.5@tcp:502:llog_process_th.0 Request processed in 901us (1473us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736406.579936:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 95 00000100:00100000:3.0:1790736406.588169:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736406.588291:0:14391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797289088 00000100:00100000:2.0:1790736406.588308:0:14391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797289088 00000100:00100000:2.0:1790736406.588384:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 96 00000100:00100000:2.0:1790736406.588417:0:14391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21106d43-d924-4418-90ae-b5795be7a32c+11:13839:x1877722797289088:12345-192.168.203.5@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790736406.588539:0:14391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736406.588567:0:14391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941611931a00/0x6aae200528fe75ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x92962417a5271e6 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736406.588656:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941611931a00/0x6aae200528fe75ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5271e6 expref: 12 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736406.588672:0:14391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941611931a00/0x6aae200528fe75ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5271e6 expref: 12 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736406.588694:0:14391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611931a00, rc 0) 00000100:00100000:2.0:1790736406.589069:0:14391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21106d43-d924-4418-90ae-b5795be7a32c+12:13839:x1877722797289088:12345-192.168.203.5@tcp:101:mount.lustre.0 Request processed in 648us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736406.589079:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 96 00000100:00100000:3.0:1790736406.604939:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736406.605373:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797289216 00000100:00100000:1.0:1790736406.605389:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797289216 00000100:00100000:1.0:1790736406.605473:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 97 00000100:00100000:1.0:1790736406.605485:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635c1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21106d43-d924-4418-90ae-b5795be7a32c+12:13839:x1877722797289216:12345-192.168.203.5@tcp:256:mount.lustre.0 20000000:01000000:1.0:1790736406.605535:0:14390:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1790736406.605568:0:14390:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1790736406.605572:0:14390:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1790736406.605576:0:14390:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1790736406.605578:0:14390:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1790736406.611968:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635c1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21106d43-d924-4418-90ae-b5795be7a32c+12:13839:x1877722797289216:12345-192.168.203.5@tcp:256:mount.lustre.0 Request processed in 6461us (7021us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736406.611990:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 97 00010000:00010000:0.0:1790736406.613441:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736406.635044:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736406.635565:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797289344 00000100:00100000:0.0:1790736406.635581:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797289344 00000100:00100000:0.0:1790736406.635662:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 98 00000100:00100000:0.0:1790736406.635674:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635c1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21106d43-d924-4418-90ae-b5795be7a32c+12:13839:x1877722797289344:12345-192.168.203.5@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790736406.635701:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736406.635728:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94163be28800/0x6aae200528fe75f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x92962417a5271ed expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736406.635771:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94163be28800/0x6aae200528fe75f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5271ed expref: 13 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736406.635786:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94163be28800/0x6aae200528fe75f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5271ed expref: 13 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736406.635797:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94163be28800, rc 0) 00000100:00100000:0.0:1790736406.636031:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635c1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21106d43-d924-4418-90ae-b5795be7a32c+13:13839:x1877722797289344:12345-192.168.203.5@tcp:101:mount.lustre.0 Request processed in 357us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736406.636039:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 98 00000100:00100000:3.0:1790736406.643321:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736406.643993:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797289472 00000100:00100000:1.0:1790736406.644008:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797289472 00000100:00100000:1.0:1790736406.644205:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 99 00000100:00100000:1.0:1790736406.644217:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635c1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21106d43-d924-4418-90ae-b5795be7a32c+13:13839:x1877722797289472:12345-192.168.203.5@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790736406.644673:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635c1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21106d43-d924-4418-90ae-b5795be7a32c+13:13839:x1877722797289472:12345-192.168.203.5@tcp:501:mount.lustre.0 Request processed in 456us (1366us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736406.644683:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 99 00000100:00100000:3.0:1790736406.649497:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736406.654210:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797289600 00000100:00100000:0.0:1790736406.654256:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797289600 00000100:00100000:0.0:1790736406.654334:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 100 00000100:00100000:0.0:1790736406.654358:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21106d43-d924-4418-90ae-b5795be7a32c+13:13839:x1877722797289600:12345-192.168.203.5@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790736406.656330:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21106d43-d924-4418-90ae-b5795be7a32c+13:13839:x1877722797289600:12345-192.168.203.5@tcp:503:mount.lustre.0 Request processed in 1962us (6835us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736406.656347:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 100 00000100:00100000:3.0:1790736406.665151:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736406.666025:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797289728 00000100:00100000:1.0:1790736406.666042:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797289728 00000100:00100000:1.0:1790736406.666134:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 101 00000100:00100000:1.0:1790736406.666145:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635c1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21106d43-d924-4418-90ae-b5795be7a32c+13:13852:x1877722797289728:12345-192.168.203.5@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790736406.667713:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635c1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21106d43-d924-4418-90ae-b5795be7a32c+13:13852:x1877722797289728:12345-192.168.203.5@tcp:502:llog_process_th.0 Request processed in 1555us (2618us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736406.667727:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 101 00000100:00100000:3.0:1790736406.671501:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736406.671807:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797289856 00000100:00100000:1.0:1790736406.671821:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797289856 00000100:00100000:1.0:1790736406.672762:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 102 00000100:00100000:1.0:1790736406.672781:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635c1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21106d43-d924-4418-90ae-b5795be7a32c+13:13852:x1877722797289856:12345-192.168.203.5@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790736406.676028:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635c1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21106d43-d924-4418-90ae-b5795be7a32c+13:13852:x1877722797289856:12345-192.168.203.5@tcp:502:llog_process_th.0 Request processed in 3237us (4525us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736406.676047:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 102 00000100:00100000:1.0:1790736406.684331:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736406.686312:0:14396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797289984 00000100:00100000:3.0:1790736406.686333:0:14396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797289984 00000100:00100000:3.0:1790736406.687032:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 10 00000100:00100000:3.0:1790736406.687045:0:14396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2352:x1877722797289984:12345-192.168.203.5@tcp:38:mount.lustre.0 00010000:00080000:3.0:1790736406.687090:0:14396:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 81cc8122-76ce-44d6-92df-050caa660a32@192.168.203.5@tcp t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:3.0:1790736406.687210:0:14396:0:(genops.c:1384:class_connect()) connect: client 81cc8122-76ce-44d6-92df-050caa660a32, cookie 0x6aae200528fe75fb 00000004:00100000:3.0:1790736406.687257:0:14396:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1790736406.688662:0:14396:0:(import.c:65:import_set_state_nolock()) ffff9416055bd000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790736406.688861:0:14396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81cc8122-76ce-44d6-92df-050caa660a32+6:2352:x1877722797289984:12345-192.168.203.5@tcp:38:mount.lustre.0 Request processed in 1807us (4532us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736406.688874:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 10 00000100:00100000:3.0:1790736406.708850:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736406.708987:0:16271:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797290240 00000100:00100000:0.0:1790736406.709003:0:16271:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797290240 00000100:00100000:0.0:1790736406.709160:0:16271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 11 00000100:00100000:0.0:1790736406.709177:0:16271:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81cc8122-76ce-44d6-92df-050caa660a32+6:13839:x1877722797290240:12345-192.168.203.5@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790736406.709225:0:16271:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790736406.709319:0:16271:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81cc8122-76ce-44d6-92df-050caa660a32+6:13839:x1877722797290240:12345-192.168.203.5@tcp:41:mount.lustre.0 Request processed in 149us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736406.709327:0:16271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 11 00000100:00080000:3.0:1790736406.709732:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790736406.725264:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736406.725775:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736406.725874:0:14396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797290112 00000100:00100000:2.0:1790736406.725887:0:14396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797290112 00000100:00100000:2.0:1790736406.725961:0:14396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797290368 00000100:00100000:2.0:1790736406.725965:0:14396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797290368 00000100:00100000:2.0:1790736406.725997:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 12 00000100:00100000:2.0:1790736406.726010:0:14396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81cc8122-76ce-44d6-92df-050caa660a32+7:0:x1877722797290112:12345-192.168.203.5@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790736406.726053:0:14396:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790736406.726180:0:14396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81cc8122-76ce-44d6-92df-050caa660a32+7:0:x1877722797290112:12345-192.168.203.5@tcp:41:mount.lustre.0 Request processed in 171us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736406.726189:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 12 00000100:00100000:2.0:1790736406.726212:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 13 00000100:00100000:2.0:1790736406.726218:0:14396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81cc8122-76ce-44d6-92df-050caa660a32+6:13839:x1877722797290368:12345-192.168.203.5@tcp:40:mount.lustre.0 00000100:00100000:2.0:1790736406.726270:0:14396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81cc8122-76ce-44d6-92df-050caa660a32+6:13839:x1877722797290368:12345-192.168.203.5@tcp:40:mount.lustre.0 Request processed in 51us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736406.726276:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 13 00000100:00100000:2.0:1790736406.731857:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736406.732047:0:14399:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797290752 00000100:00100000:1.0:1790736406.732062:0:14399:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797290752 00000100:00100000:1.0:1790736406.732182:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1 00000100:00100000:1.0:1790736406.732195:0:14399:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81cc8122-76ce-44d6-92df-050caa660a32+6:13839:x1877722797290752:12345-192.168.203.5@tcp:33:mount.lustre.0 00000004:00200000:1.0:1790736406.732310:0:14399:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1790736406.732637:0:14399:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81cc8122-76ce-44d6-92df-050caa660a32+6:13839:x1877722797290752:12345-192.168.203.5@tcp:33:mount.lustre.0 Request processed in 444us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736406.732647:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1 00000100:00100000:3.0:1790736406.732884:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736406.733035:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736406.733560:0:15078:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797290496 00000100:00100000:2.0:1790736406.733571:0:15078:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797290496 00000100:00100000:2.0:1790736406.733607:0:15078:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797290624 00000100:00100000:2.0:1790736406.733610:0:15078:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797290624 00000100:00100000:2.0:1790736406.733637:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 10 00000100:00100000:2.0:1790736406.733646:0:15078:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1877722797290496:12345-192.168.203.5@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790736406.733681:0:15078:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 81cc8122-76ce-44d6-92df-050caa660a32@192.168.203.5@tcp t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:2.0:1790736406.733725:0:15078:0:(genops.c:1384:class_connect()) connect: client 81cc8122-76ce-44d6-92df-050caa660a32, cookie 0x6aae200528fe7602 00002000:00100000:2.0:1790736406.733742:0:15078:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 81cc8122-76ce-44d6-92df-050caa660a32/ffff94162f200000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790736406.733757:0:15078:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790736406.734091:0:15078:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790736406.734171:0:15078:0:(import.c:65:import_set_state_nolock()) ffff94163faf0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790736406.734244:0:15078:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81cc8122-76ce-44d6-92df-050caa660a32+6:2352:x1877722797290496:12345-192.168.203.5@tcp:8:mount.lustre.0 Request processed in 597us (1359us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736406.734254:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 10 00000100:00100000:2.0:1790736406.734278:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 11 00000100:00100000:2.0:1790736406.734283:0:15078:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b782300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1877722797290624:12345-192.168.203.5@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790736406.734300:0:15078:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 81cc8122-76ce-44d6-92df-050caa660a32@192.168.203.5@tcp t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:2.0:1790736406.734322:0:15078:0:(genops.c:1384:class_connect()) connect: client 81cc8122-76ce-44d6-92df-050caa660a32, cookie 0x6aae200528fe7609 00002000:00100000:2.0:1790736406.734330:0:15078:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 81cc8122-76ce-44d6-92df-050caa660a32/ffff94163faf1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790736406.734370:0:15078:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790736406.735734:0:15078:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1790736406.735781:0:15078:0:(import.c:65:import_set_state_nolock()) ffff941610b30000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790736406.735999:0:15078:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b782300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81cc8122-76ce-44d6-92df-050caa660a32+6:2352:x1877722797290624:12345-192.168.203.5@tcp:8:mount.lustre.0 Request processed in 1710us (2960us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736406.736012:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 11 00000100:00100000:1.0:1790736407.008079:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736407.008615:0:14396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797290880 00000100:00100000:2.0:1790736407.008629:0:14396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797290880 00000100:00100000:2.0:1790736407.008710:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 14 00000100:00100000:2.0:1790736407.008722:0:14396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81cc8122-76ce-44d6-92df-050caa660a32+6:13873:x1877722797290880:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:2.0:1790736407.008760:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736407.008789:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe7610 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a527217 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736407.008876:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931e00/0x6aae200528fe7617 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736407.008895:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611931e00/0x6aae200528fe7617 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736407.008911:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931e00/0x6aae200528fe7617 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790736407.008955:0:14396:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790736407.008959:0:14396:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790736407.008983:0:14396:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff941611931e00/0x6aae200528fe7617 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736407.009013:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931000/0x6aae200528fe7610 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527217 expref: 8 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736407.009035:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931e00/0x6aae200528fe7617 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527217 expref: 7 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736407.009062:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff941605242100) 00010000:00010000:2.0:1790736407.009065:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790736407.009070:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611931e00, rc 0) 00000100:00100000:2.0:1790736407.009622:0:14396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81cc8122-76ce-44d6-92df-050caa660a32+7:13873:x1877722797290880:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 898us (1554us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736407.009631:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 14 00000040:00080000:1.0:1790736407.190252:0:14427:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790736407.637584:0:16095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736408.662477:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790736408.833118:0:5867:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8fa9af14-c6db-4fd8-ba33-7fb937b5df25 00000001:00100000:3.0:1790736408.833142:0:5867:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 81cc8122-76ce-44d6-92df-050caa660a32 00010000:00010000:0.0:1790736409.685530:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790736410.271568:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816157056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790736410.271603:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816157440:0@lo:400:kworker.0 00000100:00100000:0.0:1790736410.271644:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736410.271707:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877722816157568:0@lo:400:kworker.0 00000100:00100000:0.0:1790736410.271734:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736410.271766:0:16271:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816157568 00000100:00100000:0.0:1790736410.271773:0:16271:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816157568 00000100:00100000:0.0:1790736410.271819:0:16271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790736410.271828:0:16271:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877722816157568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736410.271847:0:15082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816157056 00000100:00100000:2.0:1790736410.271851:0:15082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816157056 00000100:00100000:0.0:1790736410.271880:0:16271:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877722816157568:12345-0@lo:400:kworker.0 Request processed in 52us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736410.271889:0:15082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790736410.271895:0:15082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816157056:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790736410.271896:0:16271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790736410.271939:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877722816157568:0@lo:400:kworker.0 00000100:00100000:3.0:1790736410.272240:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736410.272280:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd61a3fa-9892-475c-9015-fd1ddc473c5e:3306:1877722816157184:0@lo:400:kworker.0 00000100:00100000:3.0:1790736410.272309:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736410.272330:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1877722816157696:0@lo:400:kworker.0 00000100:00100000:3.0:1790736410.272362:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736410.272382:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1790736410.272388:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816157312:0@lo:400:kworker.0 00000100:00100000:3.0:1790736410.272409:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736410.272426:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1877722816157824:0@lo:400:kworker.0 00000100:00100000:3.0:1790736410.272445:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790736410.272475:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790736410.272487:0:15807:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816157440 00000100:00100000:3.0:1790736410.272491:0:15807:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816157440 00000100:00100000:3.0:1790736410.272527:0:15807:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816157312 00000100:00100000:3.0:1790736410.272531:0:15807:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816157312 00000100:00100000:3.0:1790736410.272557:0:15807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790736410.272571:0:15807:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1877722816157440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736410.272610:0:15807:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1877722816157440:12345-0@lo:400:kworker.0 Request processed in 40us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736410.272628:0:15807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790736410.272643:0:15807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790736410.272649:0:15807:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b780a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816157312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736410.272682:0:15807:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b780a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816157312:12345-0@lo:400:kworker.0 Request processed in 33us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736410.272687:0:15807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790736410.272704:0:14398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816157696 00000100:00100000:3.0:1790736410.272707:0:14398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816157696 00000100:00100000:3.0:1790736410.272729:0:14398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816157824 00000100:00100000:3.0:1790736410.272732:0:14398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816157824 00000100:00100000:3.0:1790736410.272752:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790736410.272757:0:14398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877722816157696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736410.272787:0:14398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877722816157696:12345-0@lo:400:kworker.0 Request processed in 30us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736410.272793:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790736410.272803:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790736410.272809:0:14398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877722816157824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736410.272836:0:14398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877722816157824:12345-0@lo:400:kworker.0 Request processed in 27us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736410.272842:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1790736410.272864:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790736410.272867:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790736410.272888:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816157312:0@lo:400:kworker.0 00000100:00100000:3.0:1790736410.272924:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1877722816157824:0@lo:400:kworker.0 00000100:00100000:3.0:1790736410.272936:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1877722816157696:0@lo:400:kworker.0 00000100:00100000:3.0:1790736410.272979:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1790736410.272989:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816157440:0@lo:400:kworker.0 00000100:00100000:3.0:1790736410.274286:0:14391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816157184 00000100:00100000:3.0:1790736410.274298:0:14391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816157184 00000100:00100000:3.0:1790736410.274340:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790736410.274349:0:14391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635c1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+19:3306:x1877722816157184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736410.274419:0:14391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635c1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+19:3306:x1877722816157184:12345-0@lo:400:kworker.0 Request processed in 72us (2109us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736410.274426:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790736410.274473:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd61a3fa-9892-475c-9015-fd1ddc473c5e:3306:1877722816157184:0@lo:400:kworker.0 00002000:00000024:2.0:1790736410.274669:0:15082:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790736410.274718:0:15082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816157056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2823us (3074us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736410.274726:0:15082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790736410.287589:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816157056:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1790736410.345088:0:7658:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 81cc8122-76ce-44d6-92df-050caa660a32 00000001:00100000:1.0:1790736410.367754:0:6725:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 81cc8122-76ce-44d6-92df-050caa660a32 00010000:00010000:0.0:1790736410.713606:0:16095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790736410.821603:0:16361:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1790736411.285455:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816157952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790736411.285545:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736411.285685:0:15083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816157952 00000100:00100000:2.0:1790736411.285694:0:15083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816157952 00000100:00100000:2.0:1790736411.285751:0:15083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790736411.285766:0:15083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816157952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790736411.285817:0:15083:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790736411.285868:0:15083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816157952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736411.285876:0:15083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790736411.285988:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816157952:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790736411.734714:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790736412.164161:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736412.164222:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736412.164245:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736412.164287:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736412.164304:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736412.164321:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736412.164341:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736412.164575:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797291008 00000100:00100000:3.0:1790736412.164596:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797291008 00000100:00100000:3.0:1790736412.164660:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 104 00000100:00100000:3.0:1790736412.164671:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635c1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21106d43-d924-4418-90ae-b5795be7a32c+13:2353:x1877722797291008:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736412.164768:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635c1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21106d43-d924-4418-90ae-b5795be7a32c+13:2353:x1877722797291008:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 99us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736412.164777:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 104 00000100:00100000:3.0:1790736412.164817:0:15807:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797291264 00000100:00100000:3.0:1790736412.164821:0:15807:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797291264 00000100:00100000:3.0:1790736412.164879:0:15807:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797291776 00000100:00100000:3.0:1790736412.164883:0:15807:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797291776 00000100:00100000:3.0:1790736412.164898:0:15807:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797291392 00000100:00100000:3.0:1790736412.164901:0:15807:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797291392 00000100:00100000:3.0:1790736412.164913:0:15807:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797291648 00000100:00100000:3.0:1790736412.164915:0:15807:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797291648 00000100:00100000:3.0:1790736412.164938:0:15807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6 00000100:00100000:3.0:1790736412.164945:0:15807:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+5:2353:x1877722797291264:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736412.164975:0:15807:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+5:2353:x1877722797291264:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 31us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736412.164982:0:15807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6 00000100:00100000:3.0:1790736412.164995:0:15807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 7 00000100:00100000:3.0:1790736412.165001:0:15807:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:81cc8122-76ce-44d6-92df-050caa660a32+5:2353:x1877722797291776:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736412.165026:0:15807:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:81cc8122-76ce-44d6-92df-050caa660a32+5:2353:x1877722797291776:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 26us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736412.165401:0:15807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 7 00000100:00100000:3.0:1790736412.165419:0:15807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 8 00000100:00100000:3.0:1790736412.165425:0:15807:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+5:2353:x1877722797291392:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736412.165454:0:15807:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+5:2353:x1877722797291392:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 30us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736412.165461:0:15807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 8 00000100:00100000:3.0:1790736412.165473:0:15807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 9 00000100:00100000:3.0:1790736412.165479:0:15807:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:81cc8122-76ce-44d6-92df-050caa660a32+5:2353:x1877722797291648:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736412.165572:0:15807:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:81cc8122-76ce-44d6-92df-050caa660a32+5:2353:x1877722797291648:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 36us (1172us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736412.165647:0:15807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 9 00000100:00100000:3.0:1790736412.165672:0:14398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797291520 00000100:00100000:3.0:1790736412.165677:0:14398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797291520 00000100:00100000:3.0:1790736412.165714:0:14398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797291136 00000100:00100000:3.0:1790736412.165717:0:14398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797291136 00000100:00100000:3.0:1790736412.165739:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 19 00000100:00100000:3.0:1790736412.165746:0:14398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81cc8122-76ce-44d6-92df-050caa660a32+6:2353:x1877722797291520:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736412.165777:0:14398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81cc8122-76ce-44d6-92df-050caa660a32+6:2353:x1877722797291520:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 32us (1531us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736412.165784:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 19 00000100:00100000:3.0:1790736412.165797:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 20 00000100:00100000:3.0:1790736412.165803:0:14398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+6:2353:x1877722797291136:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736412.165827:0:14398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+6:2353:x1877722797291136:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 25us (1522us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736412.165832:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 20 00000100:00080000:2.0:1790736412.166363:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790736412.166369:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790736412.166372:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790736412.757537:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736413.781301:0:16095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736414.805309:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736415.386859:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816158080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790736415.386937:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736415.390312:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816158336:0@lo:400:kworker.0 00000100:00100000:0.0:1790736415.390386:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736415.394438:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816158464:0@lo:400:kworker.0 00000100:00100000:1.0:1790736415.394748:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736415.395303:0:15079:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816158336 00000100:00100000:3.0:1790736415.395314:0:15079:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816158336 00000100:00100000:0.0:1790736415.395329:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1877722816158848:0@lo:400:kworker.0 00000100:00100000:2.0:1790736415.395331:0:15083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816158080 00000100:00100000:2.0:1790736415.395337:0:15083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816158080 00000100:00100000:3.0:1790736415.395367:0:15079:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816158464 00000100:00100000:3.0:1790736415.395370:0:15079:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816158464 00000100:00100000:2.0:1790736415.395372:0:15083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790736415.395378:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736415.395386:0:15083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1877722816158080:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790736415.395388:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790736415.395396:0:15079:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816158336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736415.395411:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790736415.395420:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd61a3fa-9892-475c-9015-fd1ddc473c5e:3307:1877722816158208:0@lo:400:kworker.0 00002000:00000024:2.0:1790736415.395427:0:15083:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790736415.395451:0:15079:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816158336:12345-0@lo:400:kworker.0 Request processed in 55us (5064us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736415.395471:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736415.395483:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790736415.395485:0:15083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1877722816158080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (8549us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736415.395492:0:15083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790736415.395514:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790736415.395518:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1877722816158720:0@lo:400:kworker.0 00000100:00100000:3.0:1790736415.395524:0:15079:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816158464:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1790736415.395756:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790736415.395760:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790736415.396213:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736415.396221:0:15079:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816158464:12345-0@lo:400:kworker.0 Request processed in 699us (1472us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736415.396231:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790736415.396339:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816158080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790736415.396345:0:14398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816158848 00000100:00100000:3.0:1790736415.396350:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877722816158592:0@lo:400:kworker.0 00000100:00100000:0.0:1790736415.396351:0:14398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816158848 00000100:00100000:3.0:1790736415.396385:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736415.399542:0:14398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816158720 00000100:00100000:0.0:1790736415.399560:0:14398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816158720 00000100:00100000:0.0:1790736415.399674:0:14398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816158592 00000100:00100000:0.0:1790736415.399678:0:14398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816158592 00000100:00100000:0.0:1790736415.399696:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790736415.399704:0:14398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877722816158848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736415.399795:0:14398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877722816158848:12345-0@lo:400:kworker.0 Request processed in 91us (4420us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736415.399864:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790736415.399884:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790736415.399890:0:14398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877722816158720:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1790736415.400283:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790736415.400300:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790736415.400310:0:14397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877722816158592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736415.400359:0:14397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877722816158592:12345-0@lo:400:kworker.0 Request processed in 51us (3973us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736415.400364:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790736415.400386:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816158208 00000100:00100000:3.0:1790736415.400390:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816158208 00000100:00100000:3.0:1790736415.400416:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1790736415.400422:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635c1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+19:3307:x1877722816158208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736415.400453:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635c1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+19:3307:x1877722816158208:12345-0@lo:400:kworker.0 Request processed in 31us (4994us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736415.400537:0:14398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877722816158720:12345-0@lo:400:kworker.0 Request processed in 646us (4324us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736415.400543:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790736415.400588:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1790736415.400651:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1877722816158720:0@lo:400:kworker.0 00000100:00100000:3.0:1790736415.400666:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816158336:0@lo:400:kworker.0 00000100:00100000:3.0:1790736415.400688:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1877722816158848:0@lo:400:kworker.0 00000100:00100000:3.0:1790736415.403522:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd61a3fa-9892-475c-9015-fd1ddc473c5e:3307:1877722816158208:0@lo:400:kworker.0 00000100:00100000:3.0:1790736415.403582:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877722816158592:0@lo:400:kworker.0 00000100:00100000:0.0:1790736415.404269:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816158464:0@lo:400:kworker.0 00000020:00000080:2.0:1790736415.456897:0:16509:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff8656c9d0 20000000:00000080:2.0:1790736415.456916:0:16509:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9415038df400 uarg=0000000000000000 20000000:01000000:2.0:1790736415.456953:0:16509:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790736415.456959:0:16509:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790736415.456963:0:16509:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1790736415.459424:0:16510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1790736415.459930:0:16509:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1790736415.468913:0:16509:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1790736415.471507:0:16509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff941633c60c00/0x6aae200528fe761e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736415.471534:0:16509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff941642172400/0x6aae200528fe7315 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe730e expref: 18 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736415.471543:0:16509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94163c527a00/0x6aae200528fe7362 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe735b expref: 18 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736415.471550:0:16509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff941633c60400/0x6aae200528fe7496 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe748f expref: 18 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736415.471562:0:16509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff941611931600/0x6aae200528fe75bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52718b expref: 12 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736415.471568:0:16509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94163be28800/0x6aae200528fe75f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5271ed expref: 12 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736415.471576:0:16509:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff941633c60c00/0x6aae200528fe761e lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736415.471627:0:16509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94163be28800/0x6aae200528fe75f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0x92962417a5271ed expref: 12 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736415.471658:0:16509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94163be28800/0x6aae200528fe75f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5271ed expref: 12 pid: 14389 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736415.471675:0:16509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063af480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16509:1877722816158976:192.168.203.5@tcp:104: 00010000:00010000:1.0:1790736415.471788:0:16509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff941611931600/0x6aae200528fe75bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0x92962417a52718b expref: 12 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736415.471797:0:16509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff941611931600/0x6aae200528fe75bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a52718b expref: 12 pid: 14391 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736415.471806:0:16509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063ad500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16509:1877722816159104:192.168.203.5@tcp:104: 00010000:00010000:1.0:1790736415.471837:0:16509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff941633c60400/0x6aae200528fe7496 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6aae200528fe748f expref: 18 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736415.471845:0:16509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff941633c60400/0x6aae200528fe7496 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6aae200528fe748f expref: 18 pid: 14391 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736415.471854:0:16509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063ae300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16509:1877722816159232:0@lo:104: 00000100:00100000:1.0:1790736415.471907:0:16509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790736415.471948:0:16509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94163c527a00/0x6aae200528fe7362 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6aae200528fe735b expref: 18 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736415.471955:0:16509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94163c527a00/0x6aae200528fe7362 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6aae200528fe735b expref: 18 pid: 14390 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736415.471963:0:16509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063adf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16509:1877722816159360:0@lo:104: 00000100:00100000:1.0:1790736415.471983:0:16509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736415.472051:0:14379:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816159232 00000100:00100000:3.0:1790736415.472061:0:14379:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816159232 00000100:00100000:3.0:1790736415.472125:0:14379:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816159360 00000100:00100000:3.0:1790736415.472128:0:14379:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816159360 00000100:00100000:3.0:1790736415.472144:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790736415.472157:0:14379:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+4:16509:x1877722816159232:12345-0@lo:104: 00010000:00010000:3.0:1790736415.472170:0:14379:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff94162f8c8a00/0x6aae200528fe748f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe7496 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736415.472454:0:14379:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790736415.472472:0:14379:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+4:16509:x1877722816159232:12345-0@lo:104: Request processed in 316us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736415.472481:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790736415.472499:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790736415.472506:0:14379:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+3:16509:x1877722816159360:12345-0@lo:104: 00010000:00010000:3.0:1790736415.472514:0:14379:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff941633c60000/0x6aae200528fe735b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe7362 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736415.472620:0:14385:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790736415.472628:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff94162f8c8a00/0x6aae200528fe748f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe7496 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736415.472636:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162f8c8a00 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:0.0:1790736415.472641:0:14385:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff94162f8c8a00/0x6aae200528fe748f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6aae200528fe7496 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736415.472649:0:14385:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff94162f8c8a00/0x6aae200528fe748f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6aae200528fe7496 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790736415.472656:0:14385:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff94162f8c8a00/0x6aae200528fe748f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6aae200528fe7496 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790736415.472662:0:14385:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790736415.472704:0:14385:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff94162f8c8a00/0x6aae200528fe748f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe7496 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736415.472710:0:14385:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790736415.473743:0:16509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff941642172400/0x6aae200528fe7315 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6aae200528fe730e expref: 18 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736415.473758:0:16509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff941642172400/0x6aae200528fe7315 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6aae200528fe730e expref: 18 pid: 14391 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736415.473770:0:16509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063ad180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16509:1877722816159616:0@lo:104: 00000100:00100000:1.0:1790736415.473820:0:16509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790736415.474494:0:14379:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790736415.474506:0:14379:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+3:16509:x1877722816159360:12345-0@lo:104: Request processed in 1998us (2519us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736415.474516:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790736415.474608:0:16509:0:(client.c:2716:ptlrpc_set_wait()) set ffff941633e2b300 going to sleep for 11 seconds 00000100:00100000:3.0:1790736415.474611:0:14379:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1790736415.474640:0:16509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063ae300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16509:1877722816159232:0@lo:104: 00000100:00100000:3.0:1790736415.474643:0:14379:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816159616 00000100:00100000:1.0:1790736415.474651:0:16509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063adf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16509:1877722816159360:0@lo:104: 00000100:00100000:3.0:1790736415.474652:0:14379:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816159616 00010000:00010000:1.0:1790736415.474699:0:16095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790736415.474705:0:16095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff941633c60000/0x6aae200528fe735b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe7362 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736415.474713:0:16095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60000 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:1.0:1790736415.474717:0:16095:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff941633c60000/0x6aae200528fe735b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6aae200528fe7362 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736415.474725:0:16095:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff941633c60000/0x6aae200528fe735b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6aae200528fe7362 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790736415.474732:0:16095:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff941633c60000/0x6aae200528fe735b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6aae200528fe7362 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790736415.474738:0:16095:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790736415.474767:0:16095:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff941633c60000/0x6aae200528fe735b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe7362 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736415.474774:0:16095:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790736415.474804:0:16095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff941633c60000/0x6aae200528fe735b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe7362 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736415.474811:0:16095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff941633c60000/0x6aae200528fe735b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe7362 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736415.474823:0:16095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736415.474825:0:16095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736415.474827:0:16095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790736415.474834:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790736415.474845:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd61a3fa-9892-475c-9015-fd1ddc473c5e:3309:1877722816159744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790736415.474899:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736415.474927:0:14383:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816159744 00000100:00100000:1.0:1790736415.474931:0:14383:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816159744 00010000:00010000:1.0:1790736415.474951:0:14383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94163c527a00/0x6aae200528fe7362 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe735b expref: 19 pid: 14390 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736415.474972:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790736415.474980:0:14383:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+19:3309:x1877722816159744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790736415.474991:0:14383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736415.474996:0:14383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94163c527a00/0x6aae200528fe7362 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe735b expref: 19 pid: 14390 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736415.475005:0:14383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94163c527a00/0x6aae200528fe7362 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6aae200528fe735b expref: 19 pid: 14390 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736415.475018:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94163c527a00/0x6aae200528fe7362 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6aae200528fe735b expref: 19 pid: 14390 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736415.475029:0:14383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790736415.475069:0:14383:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+18:3309:x1877722816159744:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736415.475076:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790736415.475144:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd61a3fa-9892-475c-9015-fd1ddc473c5e:3309:1877722816159744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790736415.475545:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941635cf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd61a3fa-9892-475c-9015-fd1ddc473c5e:3309:1877722816159488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790736415.475575:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790736415.475619:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff94162f8c8a00/0x6aae200528fe748f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe7496 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736415.475628:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff94162f8c8a00/0x6aae200528fe748f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe7496 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736415.475691:0:14381:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816159488 00000100:00100000:1.0:1790736415.475696:0:14381:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816159488 00010000:00010000:1.0:1790736415.475713:0:14381:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff941633c60400/0x6aae200528fe7496 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe748f expref: 18 pid: 14391 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736415.475893:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790736415.475902:0:14381:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+18:3309:x1877722816159488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790736415.475913:0:14381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736415.475918:0:14381:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff941633c60400/0x6aae200528fe7496 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe748f expref: 18 pid: 14391 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736415.475926:0:14381:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff941633c60400/0x6aae200528fe7496 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6aae200528fe748f expref: 18 pid: 14391 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736415.475937:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941633c60400/0x6aae200528fe7496 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6aae200528fe748f expref: 18 pid: 14391 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736415.475947:0:14381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790736415.476079:0:14381:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+17:3309:x1877722816159488:12345-0@lo:103:ldlm_bl.0 Request processed in 177us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736415.476086:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790736415.476190:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941635cf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd61a3fa-9892-475c-9015-fd1ddc473c5e:3309:1877722816159488:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790736415.476218:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736415.476220:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736415.476222:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790736415.476896:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790736415.476908:0:14380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ad1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+3:16509:x1877722816159616:12345-0@lo:104: 00010000:00010000:2.0:1790736415.476921:0:14380:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff941642173000/0x6aae200528fe730e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe7315 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736415.477179:0:16509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063ad180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16509:1877722816159616:0@lo:104: 00010000:00010000:2.0:1790736415.477319:0:14380:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790736415.477327:0:14380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ad1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+3:16509:x1877722816159616:12345-0@lo:104: Request processed in 422us (3507us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736415.477333:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1790736415.477918:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790736415.477926:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff941642173000/0x6aae200528fe730e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6aae200528fe7315 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736415.477935:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941642173000 already unused, calling callback (ffffffffc1c0ec20) 10000000:00010000:0.0:1790736415.477939:0:14384:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff941642173000/0x6aae200528fe730e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6aae200528fe7315 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736415.477947:0:14384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff941642173000/0x6aae200528fe730e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6aae200528fe7315 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790736415.477953:0:14384:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff941642173000/0x6aae200528fe730e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6aae200528fe7315 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790736415.477958:0:14384:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790736415.478051:0:14384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff941642173000/0x6aae200528fe730e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe7315 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736415.478059:0:14384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790736415.478109:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff941642173000/0x6aae200528fe730e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe7315 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736415.478116:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff941642173000/0x6aae200528fe730e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6aae200528fe7315 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736415.478150:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736415.478153:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790736415.478155:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736415.478381:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941635cf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd61a3fa-9892-475c-9015-fd1ddc473c5e:3306:1877722816159872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790736415.478438:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736415.478885:0:14382:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816159872 00000100:00100000:0.0:1790736415.478893:0:14382:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816159872 00010000:00010000:0.0:1790736415.478920:0:14382:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff941642172400/0x6aae200528fe7315 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe730e expref: 17 pid: 14391 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736415.478955:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790736415.478964:0:14382:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633c39450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+17:3306:x1877722816159872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790736415.478976:0:14382:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790736415.478982:0:14382:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff941642172400/0x6aae200528fe7315 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6aae200528fe730e expref: 17 pid: 14391 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736415.478990:0:14382:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff941642172400/0x6aae200528fe7315 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6aae200528fe730e expref: 17 pid: 14391 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736415.479004:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941642172400/0x6aae200528fe7315 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6aae200528fe730e expref: 17 pid: 14391 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736415.479017:0:14382:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790736415.479076:0:14382:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633c39450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+16:3306:x1877722816159872:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736415.479083:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790736415.479168:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941635cf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd61a3fa-9892-475c-9015-fd1ddc473c5e:3306:1877722816159872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790736415.482147:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736415.482184:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736415.482233:0:14382:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797291904 00000100:00100000:0.0:1790736415.482243:0:14382:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797291904 00000100:00100000:3.0:1790736415.482254:0:14381:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797292032 00000100:00100000:3.0:1790736415.482260:0:14381:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797292032 00010000:00010000:0.0:1790736415.482283:0:14382:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94163be28800/0x6aae200528fe75f4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5271ed expref: 14 pid: 14389 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736415.482285:0:14381:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff941611931600/0x6aae200528fe75bc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a52718b expref: 14 pid: 14391 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736415.482332:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 7 00000100:00100000:0.0:1790736415.482342:0:14382:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f264000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:21106d43-d924-4418-90ae-b5795be7a32c+14:2355:x1877722797292032:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790736415.482362:0:14382:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790736415.482370:0:14382:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff941611931600/0x6aae200528fe75bc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a52718b expref: 14 pid: 14391 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736415.482382:0:14382:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff941611931600/0x6aae200528fe75bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a52718b expref: 14 pid: 14391 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736415.482402:0:14382:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790736415.482426:0:16509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063af480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16509:1877722816158976:192.168.203.5@tcp:104: 00010000:00010000:1.0:1790736415.482441:0:16509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941611931600/0x6aae200528fe75bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0x92962417a52718b expref: 14 pid: 14391 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736415.482467:0:16509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063ad500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16509:1877722816159104:192.168.203.5@tcp:104: 00000100:00100000:0.0:1790736415.482472:0:14382:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f264000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:21106d43-d924-4418-90ae-b5795be7a32c+13:2355:x1877722797292032:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 114us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736415.482619:0:14383:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1790736415.482627:0:14383:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1790736415.482757:0:16509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff941633c60c00/0x6aae200528fe761e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736415.484991:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 8 00000100:00100000:3.0:1790736415.485017:0:14381:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f264a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:21106d43-d924-4418-90ae-b5795be7a32c+13:2355:x1877722797291904:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790736415.485041:0:14381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790736415.485052:0:14381:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94163be28800/0x6aae200528fe75f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5271ed expref: 13 pid: 14389 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736415.485068:0:14381:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94163be28800/0x6aae200528fe75f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5271ed expref: 13 pid: 14389 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736415.485086:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94163be28800/0x6aae200528fe75f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5271ed expref: 13 pid: 14389 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736415.485117:0:14381:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff941633c60c00/0x6aae200528fe761e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736415.485125:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941633c60c00/0x6aae200528fe761e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736415.485141:0:14381:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff941633c60c00/0x6aae200528fe761e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736415.485166:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff941633c60c00/0x6aae200528fe761e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736415.485173:0:14381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff941633c60c00/0x6aae200528fe761e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736415.485180:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff941633c60c00/0x6aae200528fe761e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736415.485187:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60c00 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:3.0:1790736415.485191:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff941633c60c00/0x6aae200528fe761e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736415.485200:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff941633c60c00/0x6aae200528fe761e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736415.485227:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff941633c60c00/0x6aae200528fe761e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736415.485237:0:14381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790736415.485290:0:14381:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f264a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:21106d43-d924-4418-90ae-b5795be7a32c+12:2355:x1877722797291904:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 286us (3151us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736415.485299:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 8 00010000:00010000:3.0:1790736415.490183:0:16509:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff941633c60c00/0x6aae200528fe761e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736415.490202:0:16509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff941633c60c00/0x6aae200528fe761e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736415.490209:0:16509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff941633c60c00/0x6aae200528fe761e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736415.490645:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 7 00010000:00010000:1.0:1790736415.829721:0:16095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790736416.406946:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163380d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816160000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790736416.407057:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736416.407773:0:15083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816160000 00000100:00100000:3.0:1790736416.407797:0:15083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816160000 00000100:00100000:3.0:1790736416.407871:0:15083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790736416.407883:0:15083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642042300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816160000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790736416.407933:0:15083:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790736416.408019:0:15083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642042300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877722816160000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736416.408027:0:15083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790736416.408232:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163380d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1877722816160000:0@lo:13:osp-pre-0-0.0 10000000:01000000:1.0:1790736416.598903:0:14393:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790736416.598915:0:14393:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9416064e9000 from 10 10000000:01000000:1.0:1790736416.598922:0:14393:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790736416.601248:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff941633c61e00/0x6aae200528fe7625 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736416.601275:0:14393:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff941633c61e00/0x6aae200528fe7625 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736416.601290:0:14393:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff941633c61e00/0x6aae200528fe7625 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736416.602077:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14393:1877722816160128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790736416.602201:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736416.602266:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff941633e2b600 going to sleep for 11 seconds 00000100:00100000:3.0:1790736416.602525:0:14391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816160128 00000100:00100000:3.0:1790736416.602536:0:14391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816160128 00000100:00100000:3.0:1790736416.602742:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790736416.602756:0:14391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635c1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+16:14393:x1877722816160128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790736416.602779:0:14391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736416.603125:0:14391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94162156e800/0x6aae200528fe762c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe7625 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736416.603167:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94162156e800/0x6aae200528fe762c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe7625 expref: 17 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736416.603180:0:14391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94162156e800/0x6aae200528fe762c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe7625 expref: 17 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736416.603190:0:14391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162156e800, rc 0) 00000100:00100000:3.0:1790736416.603265:0:14391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635c1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+17:14393:x1877722816160128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 512us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736416.603274:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790736416.604084:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14393:1877722816160128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790736416.604163:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff941633c61e00/0x6aae200528fe7625 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe762c expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736416.604176:0:14393:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff941633c61e00/0x6aae200528fe7625 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe762c expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736416.604314:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14393:1877722816160256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790736416.604374:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736416.606938:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff941633e2b600 going to sleep for 11 seconds 00000100:00100000:1.0:1790736416.609360:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816160256 00000100:00100000:1.0:1790736416.611063:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816160256 00000100:00100000:1.0:1790736416.611170:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1790736416.611181:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635c1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+17:14393:x1877722816160256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790736416.614515:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635c1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+17:14393:x1877722816160256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3322us (10127us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736416.614534:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1790736416.618219:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14393:1877722816160256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790736416.618486:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14393:1877722816160384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790736416.618665:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736416.618839:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff941633e2b600 going to sleep for 11 seconds 00000100:00100000:3.0:1790736416.619377:0:14391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816160384 00000100:00100000:3.0:1790736416.619475:0:14391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816160384 00000100:00100000:3.0:1790736416.619590:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1790736416.619602:0:14391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+17:14393:x1877722816160384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790736416.620243:0:14391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+17:14393:x1877722816160384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 642us (1575us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736416.620255:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1790736416.620528:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14393:1877722816160384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790736416.623710:0:16536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1790736416.625119:0:14393:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1790736416.625165:0:14393:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790736416.625178:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff941633c61e00/0x6aae200528fe7625 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe762c expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736416.625192:0:14393:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff941633c61e00/0x6aae200528fe7625 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe762c expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790736416.625213:0:14393:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790736416.625217:0:14393:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff941637ef8000 from 10 10000000:01000000:1.0:1790736416.625221:0:14393:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790736416.625265:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff941633c61c00/0x6aae200528fe7633 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736416.625274:0:14393:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff941633c61c00/0x6aae200528fe7633 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736416.625285:0:14393:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff941633c61c00/0x6aae200528fe7633 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736416.625504:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14393:1877722816160512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790736416.625699:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736416.625770:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416063fdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790736416.625950:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816160512 00000100:00100000:3.0:1790736416.625966:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816160512 00000100:00100000:3.0:1790736416.626490:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1790736416.626506:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635c1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+17:14393:x1877722816160512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790736416.626532:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736416.626559:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94162156ec00/0x6aae200528fe763a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe7633 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736416.626607:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94162156ec00/0x6aae200528fe763a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe7633 expref: 18 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736416.626623:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94162156ec00/0x6aae200528fe763a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe7633 expref: 18 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736416.626633:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162156ec00, rc 0) 00000100:00100000:3.0:1790736416.626714:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635c1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+18:14393:x1877722816160512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 213us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736416.626722:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1790736416.626860:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14393:1877722816160512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790736416.626887:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff941633c61c00/0x6aae200528fe7633 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe763a expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736416.626896:0:14393:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff941633c61c00/0x6aae200528fe7633 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe763a expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736416.627030:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941635cf8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14393:1877722816160640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790736416.627078:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736416.627172:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff9416063fdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790736416.627350:0:14391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816160640 00000100:00100000:3.0:1790736416.627357:0:14391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816160640 00000100:00100000:3.0:1790736416.627400:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790736416.627411:0:14391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635c1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+18:14393:x1877722816160640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790736416.627796:0:14391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635c1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+18:14393:x1877722816160640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 387us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736416.627803:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790736416.627879:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941635cf8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14393:1877722816160640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790736416.627944:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063ad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14393:1877722816160768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790736416.628025:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736416.628062:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff941633e2bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1790736416.628148:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816160768 00000100:00100000:0.0:1790736416.628155:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816160768 00000100:00100000:0.0:1790736416.628196:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1790736416.628205:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635c1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+18:14393:x1877722816160768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790736416.628441:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635c1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+18:14393:x1877722816160768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 237us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736416.628463:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1790736416.628499:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063ad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14393:1877722816160768:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790736416.633902:0:16537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1790736416.637919:0:14393:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1790736416.637957:0:14393:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790736416.637969:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff941633c61c00/0x6aae200528fe7633 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe763a expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736416.637983:0:14393:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff941633c61c00/0x6aae200528fe7633 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe763a expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790736416.637993:0:14393:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790736416.637996:0:14393:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94163af23800 from 10 10000000:01000000:2.0:1790736416.637999:0:14393:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790736416.638040:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff941611930800/0x6aae200528fe7641 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736416.638049:0:14393:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff941611930800/0x6aae200528fe7641 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736416.638061:0:14393:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff941611930800/0x6aae200528fe7641 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736416.638117:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941642040e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14393:1877722816160896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790736416.638188:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736416.638232:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611ce9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790736416.638468:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816160896 00000100:00100000:1.0:1790736416.638476:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816160896 00000100:00100000:1.0:1790736416.638531:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790736416.638541:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635c1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+18:14393:x1877722816160896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790736416.638555:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736416.638567:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941633c61200/0x6aae200528fe7648 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6aae200528fe7641 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736416.638601:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941633c61200/0x6aae200528fe7648 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6aae200528fe7641 expref: 19 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736416.638620:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941633c61200/0x6aae200528fe7648 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6aae200528fe7641 expref: 19 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736416.638628:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c61200, rc 0) 00000100:00100000:1.0:1790736416.638677:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635c1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+19:14393:x1877722816160896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736416.638685:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1790736416.638823:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941642040e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14393:1877722816160896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790736416.638838:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff941611930800/0x6aae200528fe7641 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe7648 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736416.638847:0:14393:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff941611930800/0x6aae200528fe7641 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6aae200528fe7648 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736416.638898:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941642040e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14393:1877722816161024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790736416.638924:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736416.638949:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611ce9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790736416.639025:0:14391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816161024 00000100:00100000:3.0:1790736416.639030:0:14391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816161024 00000100:00100000:3.0:1790736416.639064:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790736416.639074:0:14391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941603fb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+19:14393:x1877722816161024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790736416.641833:0:14391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941603fb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+19:14393:x1877722816161024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2752us (2897us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736416.641847:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1790736416.643068:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941642040e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14393:1877722816161024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790736416.643146:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941642040e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14393:1877722816161152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790736416.643217:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736416.643255:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611ce9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790736416.643330:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816161152 00000100:00100000:1.0:1790736416.643337:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816161152 00000100:00100000:1.0:1790736416.643386:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1790736416.643394:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941603fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+19:14393:x1877722816161152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790736416.643584:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941603fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd61a3fa-9892-475c-9015-fd1ddc473c5e+19:14393:x1877722816161152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 191us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736416.643604:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1790736416.644729:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941642040e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd61a3fa-9892-475c-9015-fd1ddc473c5e:14393:1877722816161152:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790736416.649825:0:16540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1790736416.650075:0:14393:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1790736416.650152:0:14393:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790736416.650169:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff941611930800/0x6aae200528fe7641 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe7648 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736416.650185:0:14393:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff941611930800/0x6aae200528fe7641 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6aae200528fe7648 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736416.832828:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736416.833168:0:14391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797292160 00000100:00100000:3.0:1790736416.833179:0:14391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797292160 00000100:00100000:3.0:1790736416.833236:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 115 00000100:00100000:3.0:1790736416.833246:0:14391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941603fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21106d43-d924-4418-90ae-b5795be7a32c+11:13727:x1877722797292160:12345-192.168.203.5@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790736416.833264:0:14391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736416.833282:0:14391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94162156e200/0x6aae200528fe764f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x92962417a52721e expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736416.833310:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94162156e200/0x6aae200528fe764f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52721e expref: 12 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736416.833321:0:14391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94162156e200/0x6aae200528fe764f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52721e expref: 12 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736416.833329:0:14391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162156e200, rc 0) 00000100:00100000:3.0:1790736416.833389:0:14391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941603fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21106d43-d924-4418-90ae-b5795be7a32c+12:13727:x1877722797292160:12345-192.168.203.5@tcp:101:ll_cfg_requeue.0 Request processed in 144us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736416.833407:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 115 00000100:00100000:3.0:1790736416.835385:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736416.835536:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797292288 00000100:00100000:2.0:1790736416.835545:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797292288 00000100:00100000:2.0:1790736416.835598:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 116 00000100:00100000:2.0:1790736416.835607:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941603fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21106d43-d924-4418-90ae-b5795be7a32c+12:13727:x1877722797292288:12345-192.168.203.5@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790736416.835935:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941603fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21106d43-d924-4418-90ae-b5795be7a32c+12:13727:x1877722797292288:12345-192.168.203.5@tcp:501:ll_cfg_requeue.0 Request processed in 328us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736416.835943:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 116 00000100:00100000:2.0:1790736416.842978:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736416.849546:0:14391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797292416 00000100:00100000:3.0:1790736416.849561:0:14391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797292416 00000100:00100000:1.0:1790736416.849690:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 117 00000100:00100000:1.0:1790736416.849701:0:14391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941603fba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21106d43-d924-4418-90ae-b5795be7a32c+12:13727:x1877722797292416:12345-192.168.203.5@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790736416.849935:0:14391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941603fba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21106d43-d924-4418-90ae-b5795be7a32c+12:13727:x1877722797292416:12345-192.168.203.5@tcp:503:ll_cfg_requeue.0 Request processed in 234us (7144us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736416.849943:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 117 00010000:00010000:1.0:1790736416.855291:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736416.865209:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736416.865483:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797292544 00000100:00100000:2.0:1790736416.865493:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797292544 00000100:00100000:2.0:1790736416.865547:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 118 00000100:00100000:2.0:1790736416.865557:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941603fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21106d43-d924-4418-90ae-b5795be7a32c+12:13727:x1877722797292544:12345-192.168.203.5@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790736416.865573:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736416.865590:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff941611930c00/0x6aae200528fe7656 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x92962417a527225 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736416.865618:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff941611930c00/0x6aae200528fe7656 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527225 expref: 13 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736416.865630:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff941611930c00/0x6aae200528fe7656 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527225 expref: 13 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736416.865639:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611930c00, rc 0) 00000100:00100000:2.0:1790736416.865699:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941603fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21106d43-d924-4418-90ae-b5795be7a32c+13:13727:x1877722797292544:12345-192.168.203.5@tcp:101:ll_cfg_requeue.0 Request processed in 143us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736416.865705:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 118 00000100:00100000:3.0:1790736416.878758:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736416.879320:0:14391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797292672 00000100:00100000:0.0:1790736416.879331:0:14391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797292672 00000100:00100000:0.0:1790736416.879386:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 119 00000100:00100000:0.0:1790736416.879396:0:14391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941603fb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21106d43-d924-4418-90ae-b5795be7a32c+13:13727:x1877722797292672:12345-192.168.203.5@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790736416.879680:0:14391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941603fb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21106d43-d924-4418-90ae-b5795be7a32c+13:13727:x1877722797292672:12345-192.168.203.5@tcp:501:ll_cfg_requeue.0 Request processed in 284us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736416.879689:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 119 00000100:00100000:2.0:1790736416.884969:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736416.885069:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797292800 00000100:00100000:0.0:1790736416.885080:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797292800 00000100:00100000:0.0:1790736416.885157:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 120 00000100:00100000:0.0:1790736416.885168:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941603fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21106d43-d924-4418-90ae-b5795be7a32c+13:13727:x1877722797292800:12345-192.168.203.5@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790736416.885397:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941603fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21106d43-d924-4418-90ae-b5795be7a32c+13:13727:x1877722797292800:12345-192.168.203.5@tcp:503:ll_cfg_requeue.0 Request processed in 230us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736416.885405:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 120 00000100:00100000:3.0:1790736417.284908:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736417.284951:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736417.284991:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736417.285015:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736417.285035:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736417.285064:0:14397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797293440 00000100:00100000:3.0:1790736417.285072:0:14397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797293440 00000100:00100000:3.0:1790736417.285159:0:14397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797293056 00000100:00100000:3.0:1790736417.285163:0:14397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797293056 00000100:00100000:3.0:1790736417.285187:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 24 00000100:00100000:3.0:1790736417.285196:0:14397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81cc8122-76ce-44d6-92df-050caa660a32+6:2355:x1877722797293440:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736417.285268:0:14397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81cc8122-76ce-44d6-92df-050caa660a32+6:2355:x1877722797293440:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 73us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736417.285275:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 24 00000100:00100000:3.0:1790736417.285293:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 25 00000100:00100000:3.0:1790736417.285305:0:14397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+6:2355:x1877722797293056:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736417.285330:0:14397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+6:2355:x1877722797293056:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 31us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736417.285335:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 25 00000100:00100000:3.0:1790736417.285352:0:15807:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797293184 00000100:00100000:3.0:1790736417.285369:0:15807:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797293184 00000100:00100000:3.0:1790736417.285395:0:15807:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797293696 00000100:00100000:3.0:1790736417.285398:0:15807:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797293696 00000100:00100000:3.0:1790736417.285416:0:15807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 12 00000100:00100000:3.0:1790736417.285423:0:15807:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+5:2355:x1877722797293184:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736417.285460:0:15807:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+5:2355:x1877722797293184:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 37us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736417.285466:0:15807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 12 00000100:00100000:3.0:1790736417.285478:0:15807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 13 00000100:00100000:3.0:1790736417.285483:0:15807:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:81cc8122-76ce-44d6-92df-050caa660a32+5:2355:x1877722797293696:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736417.285507:0:15807:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:81cc8122-76ce-44d6-92df-050caa660a32+5:2355:x1877722797293696:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 24us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736417.285513:0:15807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 13 00000100:00080000:3.0:1790736417.285534:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790736417.285539:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790736417.285541:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790736417.286059:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797292928 00000100:00100000:2.0:1790736417.286066:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797292928 00000100:00100000:2.0:1790736417.286137:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 121 00000100:00100000:2.0:1790736417.286145:0:14389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941603fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21106d43-d924-4418-90ae-b5795be7a32c+13:2355:x1877722797292928:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1790736417.286190:0:14389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941603fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21106d43-d924-4418-90ae-b5795be7a32c+13:2355:x1877722797292928:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 47us (1293us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736417.286197:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 121 00000100:00100000:3.0:1790736417.292715:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736417.292765:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736417.292861:0:15078:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797293312 00000100:00100000:1.0:1790736417.292870:0:15078:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797293312 00000100:00100000:1.0:1790736417.292939:0:15078:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797293568 00000100:00100000:1.0:1790736417.292942:0:15078:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797293568 00000100:00100000:1.0:1790736417.292966:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 14 00000100:00100000:1.0:1790736417.292975:0:15078:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+5:2355:x1877722797293312:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1790736417.293061:0:15078:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+5:2355:x1877722797293312:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 86us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736417.293069:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 14 00000100:00100000:1.0:1790736417.293089:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 15 00000100:00100000:1.0:1790736417.293122:0:15078:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81cc8122-76ce-44d6-92df-050caa660a32+5:2355:x1877722797293568:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1790736417.293148:0:15078:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81cc8122-76ce-44d6-92df-050caa660a32+5:2355:x1877722797293568:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 28us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736417.293154:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 15 00000100:00080000:3.0:1790736417.293333:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790736417.293337:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1790736417.440596:0:14427:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790736417.878899:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790736418.901636:0:16095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736419.813080:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736419.813229:0:14397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797293824 00000100:00100000:0.0:1790736419.813238:0:14397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797293824 00000100:00100000:0.0:1790736419.813310:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 15 00000100:00100000:0.0:1790736419.813320:0:14397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+6:14385:x1877722797293824:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790736419.813339:0:14397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736419.813361:0:14397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29200/0x6aae200528fe765d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a52722c expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.813422:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29400/0x6aae200528fe7664 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.813449:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29400/0x6aae200528fe7664 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.813462:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29400/0x6aae200528fe7664 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.813475:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29e00/0x6aae200528fe766b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.813481:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29e00/0x6aae200528fe766b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.813499:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29e00/0x6aae200528fe766b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.813795:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29c00/0x6aae200528fe7672 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.813804:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29c00/0x6aae200528fe7672 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.813810:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29c00/0x6aae200528fe7672 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790736419.813834:0:14397:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790736419.813838:0:14397:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790736419.813872:0:14397:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29c00/0x6aae200528fe7672 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.813882:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29400/0x6aae200528fe7664 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.813888:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29400/0x6aae200528fe7664 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.813894:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29400/0x6aae200528fe7664 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.813900:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163be29400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736419.813904:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29400/0x6aae200528fe7664 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.813911:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29400/0x6aae200528fe7664 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.813928:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff941605242100) 00010000:00010000:0.0:1790736419.813931:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736419.813936:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29400/0x6aae200528fe7664 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.813941:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29400/0x6aae200528fe7664 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.813953:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29e00/0x6aae200528fe766b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.813959:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29e00/0x6aae200528fe766b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.813965:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29e00/0x6aae200528fe766b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.813970:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163be29e00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736419.813973:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29e00/0x6aae200528fe766b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.813978:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29e00/0x6aae200528fe766b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.813984:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff941605a61000) 00010000:00010000:0.0:1790736419.813987:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736419.813989:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29e00/0x6aae200528fe766b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.813995:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29e00/0x6aae200528fe766b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.814035:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29200/0x6aae200528fe765d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52722c expref: 8 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.814047:0:14397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29c00/0x6aae200528fe7672 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52722c expref: 7 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.814054:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff941605a61e00) 00010000:00010000:0.0:1790736419.814056:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790736419.814059:0:14397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94163be29c00, rc 0) 00000100:00100000:0.0:1790736419.814167:0:14397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+7:14385:x1877722797293824:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 848us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736419.814174:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 15 00000100:00080000:3.0:1790736419.814333:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790736419.830828:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736419.833848:0:16271:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797294080 00000100:00100000:0.0:1790736419.833863:0:16271:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797294080 00000100:00100000:0.0:1790736419.833936:0:16271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 16 00000100:00100000:0.0:1790736419.833947:0:16271:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+7:14385:x1877722797294080:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790736419.833968:0:16271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736419.833989:0:16271:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29200/0x6aae200528fe7679 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a527233 expref: -99 pid: 16271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.834062:0:16271:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29e00/0x6aae200528fe7680 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.834076:0:16271:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29e00/0x6aae200528fe7680 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.834086:0:16271:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29e00/0x6aae200528fe7680 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.834171:0:16271:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29400/0x6aae200528fe7687 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.834179:0:16271:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29400/0x6aae200528fe7687 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.834186:0:16271:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29400/0x6aae200528fe7687 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.836522:0:16271:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29600/0x6aae200528fe768e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.836543:0:16271:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29600/0x6aae200528fe768e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.836554:0:16271:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29600/0x6aae200528fe768e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790736419.836567:0:16271:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1790736419.836762:0:16271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29e00/0x6aae200528fe7680 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.836772:0:16271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29e00/0x6aae200528fe7680 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.836779:0:16271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29e00/0x6aae200528fe7680 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.836787:0:16271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163be29e00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736419.836791:0:16271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29e00/0x6aae200528fe7680 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.836810:0:16271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29e00/0x6aae200528fe7680 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.836823:0:16271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff941605a61e00) 00010000:00010000:0.0:1790736419.836826:0:16271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736419.836831:0:16271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29e00/0x6aae200528fe7680 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.836837:0:16271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29e00/0x6aae200528fe7680 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.836850:0:16271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29400/0x6aae200528fe7687 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.836856:0:16271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29400/0x6aae200528fe7687 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.836862:0:16271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29400/0x6aae200528fe7687 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.836866:0:16271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163be29400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736419.836869:0:16271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29400/0x6aae200528fe7687 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.838255:0:16271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29400/0x6aae200528fe7687 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.838274:0:16271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff941605a61000) 00010000:00010000:0.0:1790736419.838277:0:16271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736419.838282:0:16271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29400/0x6aae200528fe7687 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.838307:0:16271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29400/0x6aae200528fe7687 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.838980:0:16271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29200/0x6aae200528fe7679 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527233 expref: 10 pid: 16271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.839000:0:16271:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29600/0x6aae200528fe768e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527233 expref: 9 pid: 16271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736419.839009:0:16271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff941605a61d00) 00010000:00010000:0.0:1790736419.839012:0:16271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736419.839015:0:16271:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94163be29600, rc 0) 00000100:00100000:0.0:1790736419.839188:0:16271:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+9:14385:x1877722797294080:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 5242us (8368us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1790736419.839199:0:16271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 16 00000100:00100000:2.0:1790736419.849630:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736419.849728:0:14397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797294208 00000100:00100000:3.0:1790736419.849737:0:14397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797294208 00000100:00100000:3.0:1790736419.849796:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 17 00000100:00100000:3.0:1790736419.849806:0:14397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+9:14385:x1877722797294208:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1790736419.854318:0:14397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+9:14385:x1877722797294208:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 Request processed in 4502us (4685us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736419.854333:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 17 00010000:00010000:1.0:1790736419.925813:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790736419.934810:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736419.934929:0:14396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797294336 00000100:00100000:3.0:1790736419.934940:0:14396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797294336 00000100:00100000:3.0:1790736419.935006:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18 00000100:00100000:3.0:1790736419.935016:0:14396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+9:14391:x1877722797294336:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1790736419.935036:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736419.935060:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fc00/0x6aae200528fe769c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a52723a expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736419.935166:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f000/0x6aae200528fe76a3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736419.935184:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f000/0x6aae200528fe76a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736419.935199:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f000/0x6aae200528fe76a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736419.935216:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e400/0x6aae200528fe76aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736419.935224:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e400/0x6aae200528fe76aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736419.935231:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e400/0x6aae200528fe76aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736419.935448:0:14396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f000/0x6aae200528fe76a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736419.935463:0:14396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f000/0x6aae200528fe76a3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736419.935470:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f000/0x6aae200528fe76a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736419.935476:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162156f000 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736419.935481:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f000/0x6aae200528fe76a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736419.935489:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f000/0x6aae200528fe76a3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736419.935501:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff941605242100) 00010000:00010000:3.0:1790736419.935504:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736419.935509:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f000/0x6aae200528fe76a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736419.935514:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f000/0x6aae200528fe76a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736419.935527:0:14396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e400/0x6aae200528fe76aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736419.935533:0:14396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e400/0x6aae200528fe76aa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736419.935538:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e400/0x6aae200528fe76aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736419.935543:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162156e400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736419.935552:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e400/0x6aae200528fe76aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736419.935559:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e400/0x6aae200528fe76aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736419.935567:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff941616119800) 00010000:00010000:3.0:1790736419.935570:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736419.935573:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e400/0x6aae200528fe76aa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736419.935579:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e400/0x6aae200528fe76aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736419.935626:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fc00/0x6aae200528fe769c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52723a expref: 10 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736419.935637:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff941605242100) 00010000:00010000:3.0:1790736419.935639:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736419.935643:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fc00/0x6aae200528fe769c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52723a expref: 10 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736419.935653:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162156fc00, rc 0) 00000100:00100000:3.0:1790736419.935705:0:14396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+9:14391:x1877722797294336:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 692us (906us total) trans 0 rc 301/301 00000100:00100000:3.0:1790736419.935713:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18 00000100:00100000:0.0:1790736419.940861:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736419.940962:0:14405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797294464 00000100:00100000:1.0:1790736419.940972:0:14405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797294464 00000100:00100000:1.0:1790736419.941018:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 0 00000100:00100000:1.0:1790736419.941026:0:14405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+9:14391:x1877722797294464:12345-192.168.203.5@tcp:700:lfs.0 00000100:00100000:1.0:1790736419.941127:0:14405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+9:14391:x1877722797294464:12345-192.168.203.5@tcp:700:lfs.0 Request processed in 101us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736419.941134:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 0 00000100:00100000:1.0:1790736419.943588:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736419.943702:0:14398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797294720 00000100:00100000:3.0:1790736419.943713:0:14398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797294720 00000100:00100000:3.0:1790736419.943769:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 19 00000100:00100000:3.0:1790736419.943778:0:14398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+9:14391:x1877722797294720:12345-192.168.203.5@tcp:36:lfs.0 00010000:00010000:3.0:1790736419.943844:0:14398:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790736419.943871:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931c00/0x6aae200528fe75df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5271b5 expref: 9 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736419.943973:0:14398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff941605242100) 00010000:00010000:3.0:1790736419.943978:0:14398:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790736419.944301:0:14398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fc00/0x6aae200528fe76b1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736419.944317:0:14398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931e00/0x6aae200528fe7617 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527217 expref: 5 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736419.944326:0:14398:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fc00/0x6aae200528fe76b1 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736419.944713:0:14398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff941611931e00/0x6aae200528fe7617 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0x92962417a527217 expref: 5 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736419.944729:0:14398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931e00/0x6aae200528fe7617 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527217 expref: 5 pid: 14396 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736419.944743:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163380dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14398:1877722816161280:192.168.203.5@tcp:104: 00000100:00100000:3.0:1790736419.944850:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff941612fd1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790736419.953001:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736419.953138:0:14381:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797294848 00000100:00100000:1.0:1790736419.953149:0:14381:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797294848 00010000:00010000:1.0:1790736419.953211:0:14381:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611931e00/0x6aae200528fe7617 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527217 expref: 6 pid: 14396 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736419.953255:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 9 00000100:00100000:1.0:1790736419.953265:0:14381:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81cc8122-76ce-44d6-92df-050caa660a32+6:2355:x1877722797294848:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790736419.953297:0:14381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736419.953305:0:14381:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff941611931e00/0x6aae200528fe7617 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527217 expref: 6 pid: 14396 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736419.953318:0:14381:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff941611931e00/0x6aae200528fe7617 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527217 expref: 6 pid: 14396 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736419.953342:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff941605242100) 00010000:00010000:1.0:1790736419.953347:0:14381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fc00/0x6aae200528fe76b1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736419.953356:0:14381:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fc00/0x6aae200528fe76b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736419.953362:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931e00/0x6aae200528fe7617 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527217 expref: 6 pid: 14396 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736419.953364:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fc00/0x6aae200528fe76b1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736419.953379:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163380dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14398:1877722816161280:192.168.203.5@tcp:104: 00010000:00010000:1.0:1790736419.953381:0:14381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790736419.953397:0:14398:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fc00/0x6aae200528fe76b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736419.953410:0:14398:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fc00/0x6aae200528fe76b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736419.953415:0:14398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fc00/0x6aae200528fe76b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736419.953437:0:14381:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81cc8122-76ce-44d6-92df-050caa660a32+5:2355:x1877722797294848:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 163us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736419.953445:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 9 00010000:00010000:3.0:1790736419.953455:0:14398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e400/0x6aae200528fe76b8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736419.953575:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e400/0x6aae200528fe76b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736419.953585:0:14398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e400/0x6aae200528fe76b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790736419.953593:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1790736419.957206:0:14398:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790736419.957227:0:14398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fc00/0x6aae200528fe76b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736419.957238:0:14398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fc00/0x6aae200528fe76b1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736419.957246:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fc00/0x6aae200528fe76b1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736419.957266:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162156fc00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736419.957271:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fc00/0x6aae200528fe76b1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736419.957278:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fc00/0x6aae200528fe76b1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736419.957294:0:14398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff941605242100) 00010000:00010000:1.0:1790736419.957297:0:14398:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736419.957301:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fc00/0x6aae200528fe76b1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736419.957308:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fc00/0x6aae200528fe76b1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790736419.957334:0:14398:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b2801b81 reply state 00000000a116edea transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e400/0x6aae200528fe76b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736419.957343:0:14398:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790736419.957525:0:14398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+10:14391:x1877722797294720:12345-192.168.203.5@tcp:36:lfs.0 Request processed in 13743us (13943us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1790736419.957534:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 19 00010000:00010000:1.0:1790736419.968143:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e400/0x6aae200528fe76b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736419.968162:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e400/0x6aae200528fe76b8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736419.968169:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e400/0x6aae200528fe76b8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736419.968194:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162156e400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736419.968199:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e400/0x6aae200528fe76b8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736419.968206:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e400/0x6aae200528fe76b8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736419.968222:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff941616119800) 00010000:00010000:1.0:1790736419.968225:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736419.968229:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e400/0x6aae200528fe76b8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736419.968234:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e400/0x6aae200528fe76b8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736420.094764:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736420.094861:0:14396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797294976 00000100:00100000:3.0:1790736420.094871:0:14396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797294976 00000100:00100000:3.0:1790736420.094935:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 20 00000100:00100000:3.0:1790736420.094946:0:14396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+9:14399:x1877722797294976:12345-192.168.203.5@tcp:101:lctl.0 00010000:00010000:3.0:1790736420.094973:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736420.094996:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f000/0x6aae200528fe76bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a527241 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.095063:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e000/0x6aae200528fe76c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.095079:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e000/0x6aae200528fe76c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.095122:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e000/0x6aae200528fe76c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790736420.095176:0:14396:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790736420.095180:0:14396:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790736420.095221:0:14396:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e000/0x6aae200528fe76c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.095246:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f000/0x6aae200528fe76bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527241 expref: 11 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.095267:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e000/0x6aae200528fe76c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527241 expref: 10 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.095276:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff941616119700) 00010000:00010000:3.0:1790736420.095279:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790736420.095282:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162156e000, rc 0) 00000100:00100000:3.0:1790736420.095636:0:14396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+10:14399:x1877722797294976:12345-192.168.203.5@tcp:101:lctl.0 Request processed in 691us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736420.095644:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 20 00000100:00100000:3.0:1790736420.129488:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736420.129624:0:14397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797295104 00000100:00100000:0.0:1790736420.129634:0:14397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797295104 00000100:00100000:0.0:1790736420.129696:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 21 00000100:00100000:0.0:1790736420.129706:0:14397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81cc8122-76ce-44d6-92df-050caa660a32+5:14400:x1877722797295104:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1790736420.129727:0:14397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736420.129747:0:14397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28200/0x6aae200528fe76cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a527248 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.129821:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28400/0x6aae200528fe76d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.129853:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28400/0x6aae200528fe76d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.129864:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28400/0x6aae200528fe76d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790736420.129915:0:14397:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790736420.129919:0:14397:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790736420.129941:0:14397:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28400/0x6aae200528fe76d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.129966:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28200/0x6aae200528fe76cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527248 expref: 7 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.129983:0:14397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28400/0x6aae200528fe76d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527248 expref: 6 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.129992:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff941616119700) 00010000:00010000:0.0:1790736420.129995:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790736420.129998:0:14397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94163be28400, rc 0) 00000100:00100000:0.0:1790736420.130065:0:14397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81cc8122-76ce-44d6-92df-050caa660a32+6:14400:x1877722797295104:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 360us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736420.130073:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 21 00000100:00100000:1.0:1790736420.133777:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736420.133874:0:14396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797295232 00000100:00100000:3.0:1790736420.133884:0:14396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797295232 00000100:00100000:3.0:1790736420.133943:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 22 00000100:00100000:3.0:1790736420.133953:0:14396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81cc8122-76ce-44d6-92df-050caa660a32+6:14400:x1877722797295232:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1790736420.133975:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736420.133996:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f000/0x6aae200528fe76db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a52724f expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.134058:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f600/0x6aae200528fe76e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.134086:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f600/0x6aae200528fe76e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.134127:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f600/0x6aae200528fe76e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.134145:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f200/0x6aae200528fe76e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.134153:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f200/0x6aae200528fe76e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.134160:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f200/0x6aae200528fe76e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.134250:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f800/0x6aae200528fe76f0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.134259:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f800/0x6aae200528fe76f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.134266:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f800/0x6aae200528fe76f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790736420.134310:0:14396:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790736420.134314:0:14396:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790736420.134335:0:14396:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f800/0x6aae200528fe76f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.134709:0:14396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f600/0x6aae200528fe76e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.134727:0:14396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f600/0x6aae200528fe76e2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.134735:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f600/0x6aae200528fe76e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.134741:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162156f600 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736420.134745:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f600/0x6aae200528fe76e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.134753:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f600/0x6aae200528fe76e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.134765:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff941616119700) 00010000:00010000:3.0:1790736420.134768:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736420.134773:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f600/0x6aae200528fe76e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.134779:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f600/0x6aae200528fe76e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.134793:0:14396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f200/0x6aae200528fe76e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.134798:0:14396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f200/0x6aae200528fe76e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.134804:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f200/0x6aae200528fe76e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.134809:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162156f200 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736420.134818:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f200/0x6aae200528fe76e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.134825:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f200/0x6aae200528fe76e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.134833:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff941616119900) 00010000:00010000:3.0:1790736420.134836:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736420.134839:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f200/0x6aae200528fe76e9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.134844:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f200/0x6aae200528fe76e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.134877:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f000/0x6aae200528fe76db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52724f expref: 8 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.134891:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f800/0x6aae200528fe76f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52724f expref: 7 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.134898:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff941616119300) 00010000:00010000:3.0:1790736420.134900:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790736420.134902:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162156f800, rc 0) 00000100:00100000:3.0:1790736420.135001:0:14396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81cc8122-76ce-44d6-92df-050caa660a32+7:14400:x1877722797295232:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1049us (1232us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736420.135008:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 22 00000100:00100000:2.0:1790736420.146517:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736420.146621:0:14397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797295488 00000100:00100000:0.0:1790736420.146632:0:14397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797295488 00000100:00100000:0.0:1790736420.146692:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 23 00000100:00100000:0.0:1790736420.146703:0:14397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81cc8122-76ce-44d6-92df-050caa660a32+7:14400:x1877722797295488:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1790736420.146726:0:14397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736420.146764:0:14397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28e00/0x6aae200528fe76f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a527256 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790736420.146859:0:14397:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1790736420.146982:0:14397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28e00/0x6aae200528fe76f7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527256 expref: 9 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.146999:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff941616119700) 00010000:00010000:0.0:1790736420.147001:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790736420.147007:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28e00/0x6aae200528fe76f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527256 expref: 9 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.147021:0:14397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94163be28e00, rc 0) 00000100:00100000:0.0:1790736420.147149:0:14397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81cc8122-76ce-44d6-92df-050caa660a32+8:14400:x1877722797295488:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 448us (641us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1790736420.147158:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 23 00000100:00100000:0.0:1790736420.155913:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736420.155994:0:16271:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797295744 00000100:00100000:3.0:1790736420.156003:0:16271:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797295744 00000100:00100000:3.0:1790736420.156062:0:16271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 24 00000100:00100000:3.0:1790736420.156072:0:16271:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81cc8122-76ce-44d6-92df-050caa660a32+8:14400:x1877722797295744:12345-192.168.203.5@tcp:36:lfs.0 00010000:00010000:3.0:1790736420.156169:0:16271:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790736420.156194:0:16271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f800/0x6aae200528fe76f0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52724f expref: 8 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.156211:0:16271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff941616119300) 00010000:00010000:3.0:1790736420.156222:0:16271:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790736420.156245:0:16271:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f000/0x6aae200528fe7705 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.156258:0:16271:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f000/0x6aae200528fe7705 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.156269:0:16271:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f000/0x6aae200528fe7705 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790736420.156497:0:16271:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b8323179 reply state 00000000f9009eb2 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f000/0x6aae200528fe7705 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736420.156507:0:16271:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1790736420.156515:0:16271:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1790736420.156599:0:16271:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81cc8122-76ce-44d6-92df-050caa660a32+9:14400:x1877722797295744:12345-192.168.203.5@tcp:36:lfs.0 Request processed in 528us (695us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1790736420.156607:0:16271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 24 00010000:00010000:0.0:1790736420.161652:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f000/0x6aae200528fe7705 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.161669:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f000/0x6aae200528fe7705 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.161678:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f000/0x6aae200528fe7705 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.161685:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162156f000 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736420.161690:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f000/0x6aae200528fe7705 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.161715:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f000/0x6aae200528fe7705 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.161731:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff941616119900) 00010000:00010000:0.0:1790736420.161734:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1790736420.161739:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f000/0x6aae200528fe7705 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.161746:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f000/0x6aae200528fe7705 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736420.163550:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736420.163974:0:16269:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797296000 00000100:00100000:3.0:1790736420.163984:0:16269:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797296000 00000100:00100000:3.0:1790736420.164041:0:16269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2 00000100:00100000:3.0:1790736420.164051:0:16269:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:81cc8122-76ce-44d6-92df-050caa660a32+8:14400:x1877722797296000:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:2.0:1790736420.164632:0:16269:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:81cc8122-76ce-44d6-92df-050caa660a32+9:14400:x1877722797296000:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 580us (1089us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1790736420.164642:0:16269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2 00000100:00100000:2.0:1790736420.167882:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736420.169919:0:14397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797296256 00000100:00100000:0.0:1790736420.169933:0:14397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797296256 00000100:00100000:0.0:1790736420.169994:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 25 00000100:00100000:0.0:1790736420.170004:0:14397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81cc8122-76ce-44d6-92df-050caa660a32+9:14400:x1877722797296256:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1790736420.170029:0:14397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736420.170051:0:14397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28e00/0x6aae200528fe770c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a52725d expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.170850:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7713 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.170867:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7713 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.170878:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7713 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.170894:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28000/0x6aae200528fe771a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.170916:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28000/0x6aae200528fe771a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.170923:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28000/0x6aae200528fe771a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790736420.171031:0:14397:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790736420.175598:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7713 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.175616:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7713 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.175622:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7713 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.175628:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163be28600 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736420.175633:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7713 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.175661:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7713 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.175676:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff941616119700) 00010000:00010000:1.0:1790736420.175679:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736420.175685:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7713 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.175691:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7713 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.175707:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28000/0x6aae200528fe771a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.175713:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28000/0x6aae200528fe771a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.175720:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28000/0x6aae200528fe771a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.175725:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163be28000 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736420.175728:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28000/0x6aae200528fe771a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.175734:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28000/0x6aae200528fe771a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.175742:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff941605a61000) 00010000:00010000:1.0:1790736420.175744:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736420.175747:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28000/0x6aae200528fe771a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.175763:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28000/0x6aae200528fe771a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.175825:0:14397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28e00/0x6aae200528fe770c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52725d expref: 11 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.175836:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff941616119700) 00010000:00010000:1.0:1790736420.175838:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790736420.175842:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28e00/0x6aae200528fe770c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52725d expref: 11 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.175852:0:14397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94163be28e00, rc 0) 00000100:00100000:1.0:1790736420.175996:0:14397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81cc8122-76ce-44d6-92df-050caa660a32+10:14400:x1877722797296256:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 5992us (8123us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1790736420.176006:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 25 00000100:00100000:2.0:1790736420.187164:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736420.188471:0:16271:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797296384 00000100:00100000:3.0:1790736420.188484:0:16271:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797296384 00000100:00100000:3.0:1790736420.188577:0:16271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 26 00000100:00100000:3.0:1790736420.188587:0:16271:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81cc8122-76ce-44d6-92df-050caa660a32+10:14400:x1877722797296384:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1790736420.188617:0:16271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736420.188642:0:16271:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f800/0x6aae200528fe7728 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a527264 expref: -99 pid: 16271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.188745:0:16271:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f200/0x6aae200528fe772f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.188759:0:16271:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f200/0x6aae200528fe772f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.188771:0:16271:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f200/0x6aae200528fe772f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790736420.188798:0:16271:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790736420.188801:0:16271:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790736420.188819:0:16271:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f200/0x6aae200528fe772f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.188845:0:16271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f800/0x6aae200528fe7728 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527264 expref: 12 pid: 16271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.188865:0:16271:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f200/0x6aae200528fe772f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527264 expref: 11 pid: 16271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.188874:0:16271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff941616119300) 00010000:00010000:3.0:1790736420.188877:0:16271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790736420.188880:0:16271:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162156f200, rc 0) 00000100:00100000:3.0:1790736420.188957:0:16271:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81cc8122-76ce-44d6-92df-050caa660a32+11:14400:x1877722797296384:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 372us (1801us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736420.188972:0:16271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 26 00000100:00100000:1.0:1790736420.203230:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736420.203329:0:14400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797296512 00000100:00100000:2.0:1790736420.203339:0:14400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797296512 00000100:00100000:2.0:1790736420.203393:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3 00000100:00100000:2.0:1790736420.203402:0:14400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81cc8122-76ce-44d6-92df-050caa660a32+11:14400:x1877722797296512:12345-192.168.203.5@tcp:37:lfs.0 00000100:00100000:2.0:1790736420.208206:0:14400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81cc8122-76ce-44d6-92df-050caa660a32+11:14400:x1877722797296512:12345-192.168.203.5@tcp:37:lfs.0 Request processed in 4792us (4973us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736420.208220:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3 00000100:00100000:3.0:1790736420.216214:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736420.216478:0:16269:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797296768 00000100:00100000:2.0:1790736420.216488:0:16269:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797296768 00000100:00100000:2.0:1790736420.216547:0:16269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 4 00000100:00100000:2.0:1790736420.216557:0:16269:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633c2e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:81cc8122-76ce-44d6-92df-050caa660a32+11:14400:x1877722797296768:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:2.0:1790736420.216827:0:16269:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633c2e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:81cc8122-76ce-44d6-92df-050caa660a32+12:14400:x1877722797296768:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 270us (620us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1790736420.216850:0:16269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 4 00000100:00100000:1.0:1790736420.332771:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736420.333147:0:14398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797296896 00000100:00100000:3.0:1790736420.333157:0:14398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797296896 00000100:00100000:3.0:1790736420.333214:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 27 00000100:00100000:3.0:1790736420.333224:0:14398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+10:14406:x1877722797296896:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:3.0:1790736420.333245:0:14398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736420.333266:0:14398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f800/0x6aae200528fe7736 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a52726b expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.333335:0:14398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f600/0x6aae200528fe773d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.333350:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f600/0x6aae200528fe773d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.333360:0:14398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f600/0x6aae200528fe773d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.333375:0:14398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fa00/0x6aae200528fe7744 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.333382:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fa00/0x6aae200528fe7744 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.333388:0:14398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fa00/0x6aae200528fe7744 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.333494:0:14398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f000/0x6aae200528fe774b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.333519:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f000/0x6aae200528fe774b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.333527:0:14398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f000/0x6aae200528fe774b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790736420.333554:0:14398:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790736420.333558:0:14398:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790736420.333595:0:14398:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f000/0x6aae200528fe774b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.333606:0:14398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f600/0x6aae200528fe773d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.333613:0:14398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f600/0x6aae200528fe773d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.333619:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f600/0x6aae200528fe773d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.333625:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162156f600 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736420.333630:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f600/0x6aae200528fe773d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.333636:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f600/0x6aae200528fe773d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.333647:0:14398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff941616119700) 00010000:00010000:3.0:1790736420.333650:0:14398:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736420.333654:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f600/0x6aae200528fe773d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.333671:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f600/0x6aae200528fe773d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.333685:0:14398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fa00/0x6aae200528fe7744 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.333690:0:14398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fa00/0x6aae200528fe7744 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.333696:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fa00/0x6aae200528fe7744 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.333701:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162156fa00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736420.333704:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fa00/0x6aae200528fe7744 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.333710:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fa00/0x6aae200528fe7744 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.333717:0:14398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff941616119100) 00010000:00010000:3.0:1790736420.333719:0:14398:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790736420.333722:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fa00/0x6aae200528fe7744 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.333728:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fa00/0x6aae200528fe7744 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.333760:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f800/0x6aae200528fe7736 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52726b expref: 12 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.333786:0:14398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f000/0x6aae200528fe774b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52726b expref: 11 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736420.333793:0:14398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff941616119300) 00010000:00010000:3.0:1790736420.333796:0:14398:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790736420.333798:0:14398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162156f000, rc 0) 00000100:00100000:3.0:1790736420.333865:0:14398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+11:14406:x1877722797296896:12345-192.168.203.5@tcp:101:bash.0 Request processed in 643us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736420.334373:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 27 00000100:00100000:3.0:1790736420.339641:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736420.339742:0:16271:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797297152 00000100:00100000:0.0:1790736420.339753:0:16271:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797297152 00000100:00100000:0.0:1790736420.339817:0:16271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 28 00000100:00100000:0.0:1790736420.339827:0:16271:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+11:14406:x1877722797297152:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:0.0:1790736420.339849:0:16271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736420.339868:0:16271:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29a00/0x6aae200528fe7752 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a527272 expref: -99 pid: 16271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.339996:0:16271:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28800/0x6aae200528fe7759 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.340011:0:16271:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f200/0x6aae200528fe772f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527264 expref: 11 pid: 16271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.340019:0:16271:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28800/0x6aae200528fe7759 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.340051:0:16271:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f200/0x6aae200528fe772f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0x92962417a527264 expref: 11 pid: 16271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.340065:0:16271:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f200/0x6aae200528fe772f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527264 expref: 11 pid: 16271 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736420.340119:0:16271:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941635cfaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16271:1877722816161408:192.168.203.5@tcp:104: 00000100:00100000:0.0:1790736420.340221:0:16271:0:(client.c:2716:ptlrpc_set_wait()) set ffff941635cc29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790736420.349775:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736420.349927:0:16511:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797297280 00000100:00100000:1.0:1790736420.349937:0:16511:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797297280 00010000:00010000:1.0:1790736420.349980:0:16511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f200/0x6aae200528fe772f lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527264 expref: 12 pid: 16271 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736420.350021:0:16511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 10 00000100:00100000:1.0:1790736420.350030:0:16511:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633802a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:81cc8122-76ce-44d6-92df-050caa660a32+12:2356:x1877722797297280:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790736420.350045:0:16511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736420.350052:0:16511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f200/0x6aae200528fe772f lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527264 expref: 12 pid: 16271 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.350078:0:16511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f200/0x6aae200528fe772f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527264 expref: 12 pid: 16271 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.350127:0:16511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff941616119300) 00010000:00010000:1.0:1790736420.350133:0:16511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28800/0x6aae200528fe7759 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.350144:0:16511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28800/0x6aae200528fe7759 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.350152:0:16511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28800/0x6aae200528fe7759 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.350170:0:16511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790736420.350226:0:16511:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633802a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:81cc8122-76ce-44d6-92df-050caa660a32+12:2356:x1877722797297280:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 196us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736420.350234:0:16511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 10 00010000:00010000:0.0:1790736420.351250:0:16271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f200/0x6aae200528fe772f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527264 expref: 11 pid: 16271 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736420.351269:0:16271:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941635cfaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16271:1877722816161408:192.168.203.5@tcp:104: 00010000:00010000:0.0:1790736420.351305:0:16271:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28800/0x6aae200528fe7759 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.351315:0:16271:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28800/0x6aae200528fe7759 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.351322:0:16271:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28800/0x6aae200528fe7759 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.351353:0:16271:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28c00/0x6aae200528fe7760 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.351365:0:16271:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28c00/0x6aae200528fe7760 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.351375:0:16271:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28c00/0x6aae200528fe7760 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.352661:0:16271:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28a00/0x6aae200528fe7767 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.352675:0:16271:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28a00/0x6aae200528fe7767 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.352693:0:16271:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28a00/0x6aae200528fe7767 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790736420.352704:0:16271:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1790736420.353972:0:16271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28800/0x6aae200528fe7759 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.353987:0:16271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28800/0x6aae200528fe7759 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.353995:0:16271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28800/0x6aae200528fe7759 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.354001:0:16271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163be28800 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736420.354005:0:16271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28800/0x6aae200528fe7759 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.354013:0:16271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28800/0x6aae200528fe7759 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.354027:0:16271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff941616119300) 00010000:00010000:0.0:1790736420.354031:0:16271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736420.354035:0:16271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28800/0x6aae200528fe7759 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.354042:0:16271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28800/0x6aae200528fe7759 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790736420.354057:0:16271:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e86209f5 reply state 00000000a21f8eb8 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28c00/0x6aae200528fe7760 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736420.354083:0:16271:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790736420.354151:0:16271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29a00/0x6aae200528fe7752 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527272 expref: 14 pid: 16271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.354166:0:16271:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28a00/0x6aae200528fe7767 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527272 expref: 13 pid: 16271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.354174:0:16271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff941605a61400) 00010000:00010000:0.0:1790736420.354177:0:16271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1790736420.354180:0:16271:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94163be28a00, rc 0) 00000100:00100000:0.0:1790736420.354270:0:16271:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+14:14406:x1877722797297152:12345-192.168.203.5@tcp:101:bash.0 Request processed in 14443us (14637us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1790736420.354291:0:16271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 28 00010000:00010000:1.0:1790736420.367867:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28c00/0x6aae200528fe7760 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.367884:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28c00/0x6aae200528fe7760 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.367891:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28c00/0x6aae200528fe7760 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.367898:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163be28c00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736420.367914:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28c00/0x6aae200528fe7760 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.367940:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28c00/0x6aae200528fe7760 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.367958:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff941605a61f00) 00010000:00010000:1.0:1790736420.367961:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736420.367966:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28c00/0x6aae200528fe7760 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.367973:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28c00/0x6aae200528fe7760 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736420.380521:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736420.380630:0:14397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797297408 00000100:00100000:1.0:1790736420.380640:0:14397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797297408 00000100:00100000:1.0:1790736420.380699:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 29 00000100:00100000:1.0:1790736420.380708:0:14397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+13:14406:x1877722797297408:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:1.0:1790736420.380733:0:14397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736420.380754:0:14397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7775 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a527279 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.380824:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61000/0x6aae200528fe777c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.380837:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61000/0x6aae200528fe777c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.380847:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61000/0x6aae200528fe777c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790736420.380886:0:14397:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1790736420.380915:0:14397:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790736420.380942:0:14397:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61000/0x6aae200528fe777c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.380953:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61000/0x6aae200528fe777c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.380975:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7775 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527279 expref: 15 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.380993:0:14397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61000/0x6aae200528fe777c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527279 expref: 14 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.381001:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff941605a61400) 00010000:00010000:1.0:1790736420.381003:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790736420.381007:0:14397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c61000, rc 0) 00000100:00100000:1.0:1790736420.381078:0:14397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+14:14406:x1877722797297408:12345-192.168.203.5@tcp:101:bash.0 Request processed in 370us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736420.381084:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 29 00000100:00100000:2.0:1790736420.388516:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736420.388656:0:14400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797297664 00000100:00100000:1.0:1790736420.388667:0:14400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797297664 00000100:00100000:1.0:1790736420.388720:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 5 00000100:00100000:1.0:1790736420.388731:0:14400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633803100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+14:14406:x1877722797297664:12345-192.168.203.5@tcp:35:bash.0 00000100:00100000:1.0:1790736420.389071:0:14400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633803100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+15:14406:x1877722797297664:12345-192.168.203.5@tcp:35:bash.0 Request processed in 341us (562us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1790736420.389078:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 5 00000100:00100000:1.0:1790736420.503570:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816161664:0@lo:400:kworker.0 00000100:00100000:1.0:1790736420.503691:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736420.503755:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1877722816162176:0@lo:400:kworker.0 00000100:00100000:1.0:1790736420.503782:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736420.503805:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1790736420.503810:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd61a3fa-9892-475c-9015-fd1ddc473c5e:3309:1877722816161536:0@lo:400:kworker.0 00000100:00100000:1.0:1790736420.503837:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736420.503857:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1877722816162048:0@lo:400:kworker.0 00000100:00100000:1.0:1790736420.503878:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736420.503903:0:15078:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816161664 00000100:00100000:1.0:1790736420.503910:0:15078:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816161664 00000100:00100000:1.0:1790736420.503958:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790736420.503967:0:15078:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816161664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790736420.504019:0:15078:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1877722816161664:12345-0@lo:400:kworker.0 Request processed in 53us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736420.504026:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790736420.504065:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1877722816161664:0@lo:400:kworker.0 00000100:00100000:2.0:1790736420.504266:0:14391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816161536 00000100:00100000:2.0:1790736420.504271:0:14391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816161536 00000100:00100000:2.0:1790736420.504298:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1790736420.504305:0:14391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941603fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+19:3309:x1877722816161536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736420.504357:0:14391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941603fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd61a3fa-9892-475c-9015-fd1ddc473c5e+19:3309:x1877722816161536:12345-0@lo:400:kworker.0 Request processed in 52us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736420.504363:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:2.0:1790736420.504387:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790736420.504678:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd61a3fa-9892-475c-9015-fd1ddc473c5e:3309:1877722816161536:0@lo:400:kworker.0 00000100:00100000:2.0:1790736420.504700:0:14396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816162176 00000100:00100000:2.0:1790736420.504703:0:14396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816162176 00000100:00100000:2.0:1790736420.504732:0:14396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816162048 00000100:00100000:2.0:1790736420.504735:0:14396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816162048 00000100:00100000:2.0:1790736420.504757:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790736420.504764:0:14396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877722816162176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736420.504802:0:14396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877722816162176:12345-0@lo:400:kworker.0 Request processed in 39us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736420.504808:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790736420.504819:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790736420.504825:0:14396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877722816162048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736420.504851:0:14396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877722816162048:12345-0@lo:400:kworker.0 Request processed in 26us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736420.504856:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1790736420.504880:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790736420.504896:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1877722816162048:0@lo:400:kworker.0 00000100:00100000:2.0:1790736420.504905:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1877722816162176:0@lo:400:kworker.0 00000040:00080000:3.0:1790736420.505255:0:14427:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790736420.505429:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816161792:0@lo:400:kworker.0 00000100:00100000:0.0:1790736420.505466:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736420.505500:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941635cfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816162304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790736420.505522:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736420.505546:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790736420.505552:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9416063aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877722816161920:0@lo:400:kworker.0 00000100:00100000:0.0:1790736420.505575:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736420.505602:0:14396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816161920 00000100:00100000:0.0:1790736420.505606:0:14396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816161920 00000100:00100000:0.0:1790736420.505632:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790736420.505638:0:14396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877722816161920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736420.505675:0:14396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877722816161920:12345-0@lo:400:kworker.0 Request processed in 37us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736420.505689:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790736420.505718:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877722816161920:0@lo:400:kworker.0 00000100:00100000:2.0:1790736420.505838:0:15079:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816161792 00000100:00100000:2.0:1790736420.505843:0:15079:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816161792 00000100:00100000:2.0:1790736420.505884:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790736420.505890:0:15079:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816161792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736420.505925:0:15079:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816161792:12345-0@lo:400:kworker.0 Request processed in 36us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736420.505932:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1790736420.506257:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790736420.506286:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9416063ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816161792:0@lo:400:kworker.0 00000100:00100000:3.0:1790736420.507065:0:15083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816162304 00000100:00100000:3.0:1790736420.507073:0:15083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816162304 00000100:00100000:3.0:1790736420.507140:0:15083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790736420.507148:0:15083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816162304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790736420.507178:0:15083:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790736420.507231:0:15083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816162304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (1708us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736420.507238:0:15083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790736420.507287:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941635cfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816162304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790736420.541734:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736420.541830:0:14397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797297920 00000100:00100000:1.0:1790736420.541839:0:14397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797297920 00000100:00100000:1.0:1790736420.541895:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 30 00000100:00100000:1.0:1790736420.541905:0:14397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633801880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+15:14416:x1877722797297920:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1790736420.541930:0:14397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736420.541951:0:14397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7783 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a527280 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790736420.542039:0:14397:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790736420.542195:0:14397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7783 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527280 expref: 17 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.542225:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff941616119700) 00010000:00010000:1.0:1790736420.542228:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790736420.542234:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7783 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527280 expref: 17 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.542247:0:14397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c61800, rc 0) 00000100:00100000:1.0:1790736420.542409:0:14397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633801880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+16:14416:x1877722797297920:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 505us (683us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1790736420.542417:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 30 00000100:00100000:3.0:1790736420.544946:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736420.545025:0:14399:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797298176 00000100:00100000:1.0:1790736420.545035:0:14399:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797298176 00000100:00100000:1.0:1790736420.545089:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6 00000100:00100000:1.0:1790736420.545122:0:14399:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+16:14416:x1877722797298176:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:1.0:1790736420.545400:0:14399:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+17:14416:x1877722797298176:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 280us (463us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1790736420.545408:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6 00000100:00100000:2.0:1790736420.627599:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736420.627703:0:14398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797298432 00000100:00100000:0.0:1790736420.627713:0:14398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797298432 00000100:00100000:0.0:1790736420.627775:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 31 00000100:00100000:0.0:1790736420.627785:0:14398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633803800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+17:14419:x1877722797298432:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1790736420.627810:0:14398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736420.627831:0:14398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29a00/0x6aae200528fe7791 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a527287 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.627925:0:14398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28800/0x6aae200528fe7798 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.627940:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28800/0x6aae200528fe7798 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.627951:0:14398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28800/0x6aae200528fe7798 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790736420.627962:0:14398:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1790736420.628086:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29a00/0x6aae200528fe7791 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527287 expref: 20 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.628134:0:14398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28800/0x6aae200528fe7798 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527287 expref: 19 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736420.628162:0:14398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff941605a61400) 00010000:00010000:0.0:1790736420.628165:0:14398:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790736420.628169:0:14398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94163be28800, rc 0) 00000100:00100000:0.0:1790736420.628228:0:14398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633803800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+19:14419:x1877722797298432:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 444us (638us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1790736420.628236:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 31 00000100:00100000:3.0:1790736420.639208:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736420.639322:0:14397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797298560 00000100:00100000:1.0:1790736420.639330:0:14397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797298560 00000100:00100000:1.0:1790736420.639397:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 32 00000100:00100000:1.0:1790736420.639406:0:14397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+19:14419:x1877722797298560:12345-192.168.203.5@tcp:54:lfs.0 00010000:00010000:1.0:1790736420.639483:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe77a6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.639500:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe77a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.639526:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe77a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.639550:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe77a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.639557:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe77a6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.639564:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe77a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.639569:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c61800 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736420.639574:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe77a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.639581:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe77a6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.639591:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff941605a61400) 00010000:00010000:1.0:1790736420.639594:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790736420.639598:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe77a6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.639604:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe77a6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736420.639673:0:14397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+19:14419:x1877722797298560:12345-192.168.203.5@tcp:54:lfs.0 Request processed in 267us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736420.639681:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 32 00000100:00100000:3.0:1790736420.649995:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736420.650045:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736420.650170:0:14381:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797298688 00000100:00100000:1.0:1790736420.650180:0:14381:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797298688 00000100:00100000:1.0:1790736420.650246:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 0 00000100:00100000:1.0:1790736420.650256:0:14381:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+19:2356:x1877722797298688:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790736420.650271:0:14381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736420.650305:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28800/0x6aae200528fe7798 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527287 expref: 19 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736420.650326:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff941605a61400) 00010000:00010000:1.0:1790736420.650331:0:14381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790736420.650393:0:14381:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+18:2356:x1877722797298688:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 138us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736420.650401:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 0 00000100:00100000:2.0:1790736420.650630:0:16269:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797298944 00000100:00100000:2.0:1790736420.650636:0:16269:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797298944 00000100:00100000:2.0:1790736420.650674:0:16269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 7 00000100:00100000:2.0:1790736420.650681:0:16269:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+18:14419:x1877722797298944:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:2.0:1790736420.650857:0:16269:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+19:14419:x1877722797298944:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 176us (812us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1790736420.650865:0:16269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 7 00010000:00010000:0.0:1790736420.949540:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790736421.074426:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736421.080347:0:14398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797299200 00000100:00100000:0.0:1790736421.080438:0:14398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797299200 00000100:00100000:0.0:1790736421.081430:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 33 00000100:00100000:0.0:1790736421.081450:0:14398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633803b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+19:14450:x1877722797299200:12345-192.168.203.5@tcp:101:cat.0 00010000:00010000:0.0:1790736421.081487:0:14398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736421.081513:0:14398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29a00/0x6aae200528fe77ad lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a52728e expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736421.081668:0:14398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28800/0x6aae200528fe77b4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736421.081686:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28800/0x6aae200528fe77b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736421.081701:0:14398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28800/0x6aae200528fe77b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790736421.081715:0:14398:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000100:00080000:2.0:1790736421.082719:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790736421.083512:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29a00/0x6aae200528fe77ad lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52728e expref: 22 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736421.083571:0:14398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28800/0x6aae200528fe77b4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52728e expref: 21 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736421.083581:0:14398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff941605a61400) 00010000:00010000:0.0:1790736421.083584:0:14398:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790736421.083587:0:14398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94163be28800, rc 0) 00000100:00100000:0.0:1790736421.083910:0:14398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633803b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+21:14450:x1877722797299200:12345-192.168.203.5@tcp:101:cat.0 Request processed in 2467us (9505us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1790736421.083920:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 33 00000100:00100000:2.0:1790736421.094216:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736421.094360:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736421.094639:0:16511:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797299328 00000100:00100000:1.0:1790736421.094653:0:16511:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797299328 00000100:00100000:1.0:1790736421.094755:0:16511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1 00000100:00100000:1.0:1790736421.094766:0:16511:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633800380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+21:2355:x1877722797299328:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790736421.094786:0:16511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736421.095043:0:16511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28800/0x6aae200528fe77b4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52728e expref: 21 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736421.095067:0:16511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff941605a61400) 00010000:00010000:1.0:1790736421.095074:0:16511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790736421.095187:0:16511:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633800380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+20:2355:x1877722797299328:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 423us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736421.095195:0:16511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1 00000100:00100000:1.0:1790736421.096353:0:14400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797299584 00000100:00100000:1.0:1790736421.096564:0:14400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797299584 00000100:00100000:1.0:1790736421.097037:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 8 00000100:00100000:1.0:1790736421.097050:0:14400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633803480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+20:14450:x1877722797299584:12345-192.168.203.5@tcp:35:cat.0 00000100:00100000:1.0:1790736421.097900:0:14400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633803480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+21:14450:x1877722797299584:12345-192.168.203.5@tcp:35:cat.0 Request processed in 848us (3534us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1790736421.097911:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 8 00000100:00100000:1.0:1790736421.221180:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736421.221366:0:14397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797299840 00000100:00100000:2.0:1790736421.221380:0:14397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797299840 00000100:00100000:2.0:1790736421.221469:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 34 00000100:00100000:2.0:1790736421.221482:0:14397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+21:14456:x1877722797299840:12345-192.168.203.5@tcp:101:dd.0 00010000:00010000:2.0:1790736421.221539:0:14397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736421.221571:0:14397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611930600/0x6aae200528fe77c2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a527295 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736421.221708:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930200/0x6aae200528fe77c9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736421.221726:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611930200/0x6aae200528fe77c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736421.221738:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611930200/0x6aae200528fe77c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790736421.221763:0:14397:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790736421.221967:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611930600/0x6aae200528fe77c2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527295 expref: 24 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736421.221990:0:14397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930200/0x6aae200528fe77c9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527295 expref: 23 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736421.222000:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff941605a61400) 00010000:00010000:2.0:1790736421.222003:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790736421.222008:0:14397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611930200, rc 0) 00000100:00100000:2.0:1790736421.222154:0:14397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+23:14456:x1877722797299840:12345-192.168.203.5@tcp:101:dd.0 Request processed in 617us (943us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1790736421.222173:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 34 00000100:00100000:0.0:1790736421.225827:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736421.225971:0:16271:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797300096 00000100:00100000:3.0:1790736421.225982:0:16271:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797300096 00000100:00100000:3.0:1790736421.226038:0:16271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 35 00000100:00100000:3.0:1790736421.226048:0:16271:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+23:14456:x1877722797300096:12345-192.168.203.5@tcp:36:dd.0 00010000:00010000:3.0:1790736421.226138:0:16271:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1790736421.226165:0:16271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611930200/0x6aae200528fe77c9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527295 expref: 23 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736421.226188:0:16271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61000/0x6aae200528fe777c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527279 expref: 22 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736421.226199:0:16271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff941605a61400) 00010000:00010000:3.0:1790736421.226204:0:16271:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790736421.226408:0:16271:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fa00/0x6aae200528fe77d7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736421.226441:0:16271:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fa00/0x6aae200528fe77d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736421.226450:0:16271:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fa00/0x6aae200528fe77d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790736421.226501:0:16271:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1790736421.226535:0:16271:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000037991abe reply state 0000000040339141 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fa00/0x6aae200528fe77d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736421.226545:0:16271:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790736421.226996:0:16271:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+24:14456:x1877722797300096:12345-192.168.203.5@tcp:36:dd.0 Request processed in 947us (1176us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1790736421.227005:0:16271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 35 00000020:00080000:3.0:1790736421.227024:0:16271:0:(tgt_main.c:787:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790736421.230041:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fa00/0x6aae200528fe77d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736421.230057:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fa00/0x6aae200528fe77d7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736421.230065:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fa00/0x6aae200528fe77d7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736421.230072:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162156fa00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736421.230076:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fa00/0x6aae200528fe77d7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736421.230083:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fa00/0x6aae200528fe77d7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736421.230141:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff941605a61400) 00010000:00010000:0.0:1790736421.230145:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736421.230164:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fa00/0x6aae200528fe77d7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736421.230171:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fa00/0x6aae200528fe77d7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736421.337404:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736421.337592:0:14399:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797300352 00000100:00100000:1.0:1790736421.337602:0:14399:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797300352 00000100:00100000:1.0:1790736421.337664:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 9 00000100:00100000:1.0:1790736421.337674:0:14399:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+23:14456:x1877722797300352:12345-192.168.203.5@tcp:35:dd.0 00000100:00100000:1.0:1790736421.337922:0:14399:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+24:14456:x1877722797300352:12345-192.168.203.5@tcp:35:dd.0 Request processed in 249us (526us total) trans 8589934611 rc 0/0 00000100:00100000:1.0:1790736421.337928:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 9 00000100:00100000:1.0:1790736421.527488:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790736421.527515:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163380d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816162432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790736421.527586:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736421.528837:0:15083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816162432 00000100:00100000:3.0:1790736421.528851:0:15083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816162432 00000100:00100000:3.0:1790736421.528914:0:15083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790736421.528923:0:15083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816162432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790736421.528959:0:15083:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790736421.529035:0:15083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816162432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (1447us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736421.529041:0:15083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790736421.531535:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163380d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816162432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790736421.747542:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736421.747957:0:14397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797300480 00000100:00100000:2.0:1790736421.747968:0:14397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797300480 00000100:00100000:2.0:1790736421.748031:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 36 00000100:00100000:2.0:1790736421.748057:0:14397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+24:14470:x1877722797300480:12345-192.168.203.5@tcp:101:stat.0 00010000:00010000:2.0:1790736421.748085:0:14397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736421.748164:0:14397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611930600/0x6aae200528fe77de lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a52729c expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736421.748233:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930e00/0x6aae200528fe77e5 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736421.748248:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611930e00/0x6aae200528fe77e5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736421.748259:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611930e00/0x6aae200528fe77e5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736421.748287:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931200/0x6aae200528fe77ec lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736421.748295:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611931200/0x6aae200528fe77ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736421.748301:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931200/0x6aae200528fe77ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736421.748383:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931400/0x6aae200528fe77f3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736421.748392:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611931400/0x6aae200528fe77f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736421.748399:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931400/0x6aae200528fe77f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790736421.748455:0:14397:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1790736421.748460:0:14397:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790736421.748504:0:14397:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff941611931400/0x6aae200528fe77f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736421.748517:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611931400/0x6aae200528fe77f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736421.748526:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930e00/0x6aae200528fe77e5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736421.748534:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611930e00/0x6aae200528fe77e5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736421.748541:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941611930e00/0x6aae200528fe77e5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736421.748547:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941611930e00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736421.748551:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611930e00/0x6aae200528fe77e5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736421.748558:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611930e00/0x6aae200528fe77e5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736421.748569:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff941616119300) 00010000:00010000:2.0:1790736421.748573:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790736421.748577:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941611930e00/0x6aae200528fe77e5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736421.748583:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611930e00/0x6aae200528fe77e5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736421.748608:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931200/0x6aae200528fe77ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736421.748614:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611931200/0x6aae200528fe77ec lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736421.748620:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941611931200/0x6aae200528fe77ec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736421.748625:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941611931200 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736421.748628:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611931200/0x6aae200528fe77ec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736421.748634:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611931200/0x6aae200528fe77ec lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736421.748642:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff941605242900) 00010000:00010000:2.0:1790736421.748644:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790736421.748646:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941611931200/0x6aae200528fe77ec lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736421.748652:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931200/0x6aae200528fe77ec lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736421.748683:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611930600/0x6aae200528fe77de lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52729c expref: 26 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736421.748697:0:14397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931400/0x6aae200528fe77f3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52729c expref: 25 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736421.748716:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff941605a61400) 00010000:00010000:2.0:1790736421.748718:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790736421.748721:0:14397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611931400, rc 0) 00000100:00100000:2.0:1790736421.748968:0:14397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+25:14470:x1877722797300480:12345-192.168.203.5@tcp:101:stat.0 Request processed in 912us (1433us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736421.748976:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 36 00000100:00100000:3.0:1790736421.859930:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736421.860042:0:14398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797300736 00000100:00100000:0.0:1790736421.860051:0:14398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797300736 00000100:00100000:0.0:1790736421.860138:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 37 00000100:00100000:0.0:1790736421.860148:0:14398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+25:14476:x1877722797300736:12345-192.168.203.5@tcp:36:truncate.0 00010000:00010000:0.0:1790736421.860197:0:14398:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790736421.860223:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931400/0x6aae200528fe77f3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a52729c expref: 25 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736421.860242:0:14398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff941605a61400) 00010000:00010000:0.0:1790736421.860247:0:14398:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790736421.860477:0:14398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28e00/0x6aae200528fe77fa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736421.860491:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28e00/0x6aae200528fe77fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736421.860500:0:14398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28e00/0x6aae200528fe77fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790736421.860552:0:14398:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:0.0:1790736421.860579:0:14398:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000944d6e73 reply state 00000000299729b3 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28e00/0x6aae200528fe77fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736421.860606:0:14398:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790736421.860717:0:14398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+27:14476:x1877722797300736:12345-192.168.203.5@tcp:36:truncate.0 Request processed in 570us (796us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1790736421.860724:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 37 00000020:00080000:0.0:1790736421.860729:0:14398:0:(tgt_main.c:787:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790736421.869138:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28e00/0x6aae200528fe77fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736421.869155:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28e00/0x6aae200528fe77fa lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736421.869164:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28e00/0x6aae200528fe77fa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736421.869171:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163be28e00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736421.869176:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28e00/0x6aae200528fe77fa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736421.869199:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28e00/0x6aae200528fe77fa lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736421.869215:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff941605a61400) 00010000:00010000:1.0:1790736421.869217:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736421.869222:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28e00/0x6aae200528fe77fa lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736421.869229:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28e00/0x6aae200528fe77fa lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736421.974070:0:16095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736422.087853:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736422.088298:0:14396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797300864 00000100:00100000:0.0:1790736422.088310:0:14396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797300864 00000100:00100000:0.0:1790736422.088369:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 38 00000100:00100000:0.0:1790736422.088378:0:14396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+26:14490:x1877722797300864:12345-192.168.203.5@tcp:101:stat.0 00010000:00010000:0.0:1790736422.088405:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736422.088435:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28000/0x6aae200528fe7801 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a5272a3 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.088505:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7808 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.088520:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7808 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.088532:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7808 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.088546:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28200/0x6aae200528fe780f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.088553:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28200/0x6aae200528fe780f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.088558:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28200/0x6aae200528fe780f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.088659:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29e00/0x6aae200528fe7816 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.088669:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29e00/0x6aae200528fe7816 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.088675:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29e00/0x6aae200528fe7816 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790736422.088708:0:14396:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1790736422.088712:0:14396:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790736422.088733:0:14396:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29e00/0x6aae200528fe7816 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.088744:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29e00/0x6aae200528fe7816 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.088753:0:14396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7808 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.088760:0:14396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7808 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.088766:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7808 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.088772:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163be28600 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736422.088777:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7808 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.088784:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7808 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.088803:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff941616119300) 00010000:00010000:0.0:1790736422.088806:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736422.088811:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7808 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.088818:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7808 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.088831:0:14396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28200/0x6aae200528fe780f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.088837:0:14396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28200/0x6aae200528fe780f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.088841:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28200/0x6aae200528fe780f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.088846:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163be28200 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736422.088849:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28200/0x6aae200528fe780f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.088855:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28200/0x6aae200528fe780f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.088862:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff941605a61500) 00010000:00010000:0.0:1790736422.088864:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736422.088867:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28200/0x6aae200528fe780f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.088873:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28200/0x6aae200528fe780f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.088915:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28000/0x6aae200528fe7801 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272a3 expref: 28 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.088928:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29e00/0x6aae200528fe7816 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272a3 expref: 27 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.088935:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff941605a61400) 00010000:00010000:0.0:1790736422.088937:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790736422.088940:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94163be29e00, rc 0) 00000100:00100000:0.0:1790736422.089021:0:14396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+27:14490:x1877722797300864:12345-192.168.203.5@tcp:101:stat.0 Request processed in 644us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736422.089030:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 38 00000100:00100000:0.0:1790736422.214843:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736422.215139:0:14398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797301120 00000100:00100000:2.0:1790736422.215159:0:14398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797301120 00000100:00100000:2.0:1790736422.215223:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 39 00000100:00100000:2.0:1790736422.215233:0:14398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+27:14500:x1877722797301120:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1790736422.215253:0:14398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736422.215273:0:14398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931200/0x6aae200528fe781d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a5272aa expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790736422.215361:0:14398:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790736422.215490:0:14398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931200/0x6aae200528fe781d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272aa expref: 29 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.215505:0:14398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff941616119700) 00010000:00010000:2.0:1790736422.215508:0:14398:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790736422.215514:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931200/0x6aae200528fe781d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272aa expref: 29 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.215527:0:14398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611931200, rc 0) 00000100:00100000:2.0:1790736422.215590:0:14398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+28:14500:x1877722797301120:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 358us (755us total) trans 8589934614 rc 301/301 00000100:00100000:2.0:1790736422.215613:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 39 00000100:00100000:3.0:1790736422.218902:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736422.219000:0:14400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797301376 00000100:00100000:1.0:1790736422.219010:0:14400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797301376 00000100:00100000:1.0:1790736422.219061:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 10 00000100:00100000:1.0:1790736422.219070:0:14400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633c2d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+28:14500:x1877722797301376:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:1.0:1790736422.219325:0:14400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633c2d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+29:14500:x1877722797301376:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 254us (430us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1790736422.219333:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 10 00000100:00100000:3.0:1790736422.300191:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736422.300302:0:14396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797301632 00000100:00100000:0.0:1790736422.300311:0:14396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797301632 00000100:00100000:0.0:1790736422.300373:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 40 00000100:00100000:0.0:1790736422.300383:0:14396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+29:14506:x1877722797301632:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:0.0:1790736422.300420:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736422.300456:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28200/0x6aae200528fe782b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a5272b1 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.300556:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7832 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.300570:0:14396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28a00/0x6aae200528fe7767 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527272 expref: 30 pid: 16271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.300599:0:14396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29e00/0x6aae200528fe7816 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272a3 expref: 30 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.300608:0:14396:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7832 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.300640:0:14396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29e00/0x6aae200528fe7816 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0x92962417a5272a3 expref: 30 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.300654:0:14396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29e00/0x6aae200528fe7816 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5272a3 expref: 30 pid: 14396 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736422.300666:0:14396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941635cfad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14396:1877722816162560:192.168.203.5@tcp:104: 00010000:00010000:0.0:1790736422.300778:0:14396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28a00/0x6aae200528fe7767 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0x92962417a527272 expref: 30 pid: 16271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.300788:0:14396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28a00/0x6aae200528fe7767 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527272 expref: 30 pid: 16271 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736422.300797:0:14396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941635cfb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14396:1877722816162688:192.168.203.5@tcp:104: 00000100:00100000:0.0:1790736422.300821:0:14396:0:(client.c:2716:ptlrpc_set_wait()) set ffff941602e0c780 going to sleep for 11 seconds 00000100:00100000:2.0:1790736422.306152:0:14396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941635cfad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14396:1877722816162560:192.168.203.5@tcp:104: 00000100:00100000:2.0:1790736422.306168:0:14396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941635cfb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14396:1877722816162688:192.168.203.5@tcp:104: 00010000:00010000:2.0:1790736422.306197:0:14396:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7832 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736422.307226:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736422.307360:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736422.308724:0:14381:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797301760 00000100:00100000:1.0:1790736422.308735:0:14381:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797301760 00010000:00010000:1.0:1790736422.308779:0:14381:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29e00/0x6aae200528fe7816 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5272a3 expref: 31 pid: 14396 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736422.308819:0:14381:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797301888 00000100:00100000:1.0:1790736422.308823:0:14381:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797301888 00010000:00010000:1.0:1790736422.308836:0:14381:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28a00/0x6aae200528fe7767 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527272 expref: 32 pid: 16271 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736422.308889:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 11 00000100:00100000:1.0:1790736422.308899:0:14381:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633c3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+32:2356:x1877722797301760:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790736422.308915:0:14381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736422.308922:0:14381:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29e00/0x6aae200528fe7816 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5272a3 expref: 32 pid: 14396 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.308934:0:14381:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29e00/0x6aae200528fe7816 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5272a3 expref: 32 pid: 14396 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.308954:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29e00/0x6aae200528fe7816 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5272a3 expref: 32 pid: 14396 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.308969:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff941605a61400) 00010000:00010000:1.0:1790736422.308974:0:14381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7832 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.308982:0:14381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7832 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.308988:0:14381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790736422.309044:0:14381:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633c3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+31:2356:x1877722797301760:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 146us (1824us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736422.309051:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 11 00000100:00100000:1.0:1790736422.309129:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 12 00000100:00100000:1.0:1790736422.309136:0:14381:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b781f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+30:2356:x1877722797301888:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790736422.309152:0:14381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736422.309157:0:14381:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28a00/0x6aae200528fe7767 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527272 expref: 30 pid: 16271 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.309166:0:14381:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28a00/0x6aae200528fe7767 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527272 expref: 30 pid: 16271 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.309177:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28a00/0x6aae200528fe7767 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0x92962417a527272 expref: 30 pid: 16271 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.309186:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff941605a61400) 00010000:00010000:1.0:1790736422.309189:0:14381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7832 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.309196:0:14381:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7832 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.309203:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7832 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.309224:0:14381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790736422.309243:0:14381:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b781f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+29:2356:x1877722797301888:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 108us (1885us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736422.309249:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 12 00010000:00010000:2.0:1790736422.309386:0:14396:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7832 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.309396:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7832 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790736422.309645:0:14396:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:2.0:1790736422.309797:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28200/0x6aae200528fe782b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272b1 expref: 30 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.309813:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7832 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272b1 expref: 29 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.309821:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff941605a61400) 00010000:00010000:2.0:1790736422.309823:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790736422.309826:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94163be28600, rc 0) 00000100:00100000:2.0:1790736422.309854:0:14396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+29:14506:x1877722797301632:12345-192.168.203.5@tcp:101:bash.0 Request processed in 9473us (9674us total) trans 8589934616 rc 0/0 00000100:00100000:2.0:1790736422.309861:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 40 00000100:00100000:1.0:1790736422.313810:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736422.313941:0:16271:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797302144 00000100:00100000:3.0:1790736422.313951:0:16271:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797302144 00000100:00100000:3.0:1790736422.314035:0:16271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 41 00000100:00100000:3.0:1790736422.314045:0:16271:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+29:14506:x1877722797302144:12345-192.168.203.5@tcp:36:bash.0 00010000:00010000:3.0:1790736422.314607:0:16271:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f800/0x6aae200528fe7840 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.314625:0:16271:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f800/0x6aae200528fe7840 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.314635:0:16271:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f800/0x6aae200528fe7840 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790736422.314709:0:16271:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:3.0:1790736422.314735:0:16271:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b15ce943 reply state 0000000049d988ec transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f800/0x6aae200528fe7840 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736422.314744:0:16271:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790736422.314876:0:16271:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+32:14506:x1877722797302144:12345-192.168.203.5@tcp:36:bash.0 Request processed in 831us (1073us total) trans 8589934618 rc 0/0 00000100:00100000:3.0:1790736422.314884:0:16271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 41 00000020:00080000:3.0:1790736422.314889:0:16271:0:(tgt_main.c:787:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790736422.318437:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f800/0x6aae200528fe7840 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.318461:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f800/0x6aae200528fe7840 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.318489:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f800/0x6aae200528fe7840 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.318496:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162156f800 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736422.318500:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f800/0x6aae200528fe7840 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.318508:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f800/0x6aae200528fe7840 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.318523:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff941605a61400) 00010000:00010000:0.0:1790736422.318527:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736422.318532:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f800/0x6aae200528fe7840 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.318538:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f800/0x6aae200528fe7840 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736422.319691:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736422.319763:0:14397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797302272 00000100:00100000:2.0:1790736422.319773:0:14397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797302272 00000100:00100000:2.0:1790736422.319843:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 42 00000100:00100000:2.0:1790736422.319853:0:14397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+31:14506:x1877722797302272:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:2.0:1790736422.319878:0:14397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736422.319897:0:14397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931200/0x6aae200528fe7847 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a5272b8 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.319959:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611931200/0x6aae200528fe7847 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272b8 expref: 32 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.319974:0:14397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931200/0x6aae200528fe7847 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272b8 expref: 32 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.319996:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff941605a61400) 00010000:00010000:2.0:1790736422.319999:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790736422.320002:0:14397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611931200, rc 0) 00000100:00100000:2.0:1790736422.320060:0:14397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+32:14506:x1877722797302272:12345-192.168.203.5@tcp:101:bash.0 Request processed in 208us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736422.320067:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 42 00000100:00100000:1.0:1790736422.327195:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736422.327286:0:14398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797302400 00000100:00100000:2.0:1790736422.327300:0:14398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797302400 00000100:00100000:2.0:1790736422.327364:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 43 00000100:00100000:2.0:1790736422.327375:0:14398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+32:14506:x1877722797302400:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:2.0:1790736422.327395:0:14398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736422.327427:0:14398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611930e00/0x6aae200528fe784e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a5272bf expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.327517:0:14398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930000/0x6aae200528fe7855 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.327546:0:14398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7832 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272b1 expref: 33 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.327554:0:14398:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611930000/0x6aae200528fe7855 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.327589:0:14398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7832 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0x92962417a5272b1 expref: 33 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.327603:0:14398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7832 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5272b1 expref: 33 pid: 14396 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736422.327617:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941633800e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14398:1877722816162816:192.168.203.5@tcp:104: 00000100:00100000:2.0:1790736422.327704:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611ce9300 going to sleep for 11 seconds 00000100:00100000:0.0:1790736422.334253:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941633800e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14398:1877722816162816:192.168.203.5@tcp:104: 00010000:00010000:0.0:1790736422.334295:0:14398:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff941611930000/0x6aae200528fe7855 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736422.335801:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736422.335884:0:14381:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797302528 00000100:00100000:3.0:1790736422.335892:0:14381:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797302528 00010000:00010000:3.0:1790736422.335930:0:14381:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7832 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5272b1 expref: 34 pid: 14396 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736422.335973:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 13 00000100:00100000:3.0:1790736422.335982:0:14381:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+34:2356:x1877722797302528:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790736422.335996:0:14381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790736422.336003:0:14381:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7832 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5272b1 expref: 34 pid: 14396 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.336015:0:14381:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7832 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5272b1 expref: 34 pid: 14396 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.336037:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7832 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5272b1 expref: 34 pid: 14396 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.336052:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff941605a61400) 00010000:00010000:3.0:1790736422.336069:0:14381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff941611930000/0x6aae200528fe7855 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.336079:0:14381:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff941611930000/0x6aae200528fe7855 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.336087:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611930000/0x6aae200528fe7855 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.336157:0:14381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790736422.336207:0:14381:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+33:2356:x1877722797302528:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 226us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736422.336215:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 13 00010000:00010000:0.0:1790736422.336354:0:14398:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff941611930000/0x6aae200528fe7855 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.336362:0:14398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611930000/0x6aae200528fe7855 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790736422.336530:0:14398:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1790736422.336535:0:14398:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790736422.336568:0:14398:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff941611930000/0x6aae200528fe7855 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.336600:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611930e00/0x6aae200528fe784e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272bf expref: 33 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.336615:0:14398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930000/0x6aae200528fe7855 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272bf expref: 32 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.336623:0:14398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff941605a61400) 00010000:00010000:0.0:1790736422.336626:0:14398:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790736422.336628:0:14398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611930000, rc 0) 00000100:00100000:0.0:1790736422.336671:0:14398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+32:14506:x1877722797302400:12345-192.168.203.5@tcp:101:bash.0 Request processed in 9298us (9485us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736422.336678:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 43 00000100:00100000:1.0:1790736422.342034:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736422.342140:0:14383:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797302784 00000100:00100000:3.0:1790736422.342150:0:14383:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797302784 00000100:00100000:3.0:1790736422.342214:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2 00000100:00100000:3.0:1790736422.342224:0:14383:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9416063ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+32:14506:x1877722797302784:12345-192.168.203.5@tcp:103:bash.0 00010000:00010000:3.0:1790736422.342240:0:14383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1790736422.342277:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611930000/0x6aae200528fe7855 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272bf expref: 32 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.342300:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931200/0x6aae200528fe7847 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272b8 expref: 31 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.342309:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff941605a61400) 00010000:00010000:3.0:1790736422.342320:0:14383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790736422.342387:0:14383:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9416063ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+30:14506:x1877722797302784:12345-192.168.203.5@tcp:103:bash.0 Request processed in 165us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736422.342395:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2 00000100:00100000:3.0:1790736422.345521:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736422.345621:0:14397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797302912 00000100:00100000:2.0:1790736422.345633:0:14397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797302912 00000100:00100000:2.0:1790736422.345684:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 44 00000100:00100000:2.0:1790736422.345693:0:14397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+30:14506:x1877722797302912:12345-192.168.203.5@tcp:58:bash.0 00010000:00010000:2.0:1790736422.345793:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931e00/0x6aae200528fe785c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.345810:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611931e00/0x6aae200528fe785c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.345821:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931e00/0x6aae200528fe785c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790736422.347222:0:14397:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790736422.347423:0:14397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1790736422.347813:0:14397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1790736422.347994:0:14397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+30:14506:x1877722797302912:12345-192.168.203.5@tcp:58:bash.0 Request processed in 2296us (2553us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736422.348005:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 44 00000100:00100000:1.0:1790736422.351293:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736422.351680:0:16271:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797303040 00000100:00100000:3.0:1790736422.351691:0:16271:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797303040 00000100:00100000:3.0:1790736422.351753:0:16271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 45 00000100:00100000:3.0:1790736422.351764:0:16271:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163fae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+30:14506:x1877722797303040:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:3.0:1790736422.351785:0:16271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736422.351805:0:16271:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e400/0x6aae200528fe7863 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a5272c6 expref: -99 pid: 16271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.351862:0:16271:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931e00/0x6aae200528fe785c lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.351874:0:16271:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e400/0x6aae200528fe7863 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272c6 expref: 31 pid: 16271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.351893:0:16271:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff941611931e00/0x6aae200528fe785c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.351906:0:16271:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e400/0x6aae200528fe7863 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272c6 expref: 31 pid: 16271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.351919:0:16271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff941605242900) 00010000:00010000:3.0:1790736422.351922:0:16271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790736422.351927:0:16271:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e400/0x6aae200528fe7863 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272c6 expref: 31 pid: 16271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.351934:0:16271:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162156e400, rc 0) 00000100:00100000:3.0:1790736422.352041:0:16271:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163fae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+31:14506:x1877722797303040:12345-192.168.203.5@tcp:101:bash.0 Request processed in 278us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736422.352064:0:16271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 45 00000100:00100000:1.0:1790736422.399927:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736422.399975:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736422.400058:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736422.400124:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736422.400149:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736422.400173:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736422.400214:0:14390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797303168 00000100:00100000:1.0:1790736422.400223:0:14390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797303168 00000100:00100000:1.0:1790736422.400281:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 123 00000100:00100000:1.0:1790736422.400290:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941603fba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21106d43-d924-4418-90ae-b5795be7a32c+13:2356:x1877722797303168:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1790736422.400354:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941603fba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21106d43-d924-4418-90ae-b5795be7a32c+13:2356:x1877722797303168:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 65us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736422.400362:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 123 00000100:00100000:3.0:1790736422.400540:0:15081:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797303296 00000100:00100000:3.0:1790736422.400545:0:15081:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797303296 00000100:00100000:3.0:1790736422.400575:0:15081:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797303808 00000100:00100000:3.0:1790736422.400578:0:15081:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797303808 00000100:00100000:3.0:1790736422.400590:0:15081:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797303424 00000100:00100000:3.0:1790736422.400593:0:15081:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797303424 00000100:00100000:3.0:1790736422.400603:0:15081:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797303680 00000100:00100000:3.0:1790736422.400605:0:15081:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797303680 00000100:00100000:3.0:1790736422.400619:0:15081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18 00000100:00100000:3.0:1790736422.400625:0:15081:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+5:2356:x1877722797303296:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736422.400657:0:15081:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+5:2356:x1877722797303296:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 31us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736422.400663:0:15081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18 00000100:00100000:3.0:1790736422.400676:0:15081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 19 00000100:00100000:3.0:1790736422.400683:0:15081:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:81cc8122-76ce-44d6-92df-050caa660a32+5:2356:x1877722797303808:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736422.400707:0:15081:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:81cc8122-76ce-44d6-92df-050caa660a32+5:2356:x1877722797303808:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 25us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736422.400714:0:15081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 19 00000100:00100000:3.0:1790736422.400725:0:15081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 20 00000100:00100000:3.0:1790736422.400731:0:15081:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160312df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+5:2356:x1877722797303424:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736422.400755:0:15081:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160312df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+5:2356:x1877722797303424:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 24us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736422.400761:0:15081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 20 00000100:00100000:3.0:1790736422.400772:0:15081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 21 00000100:00100000:3.0:1790736422.400790:0:15081:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160312c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:81cc8122-76ce-44d6-92df-050caa660a32+5:2356:x1877722797303680:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1790736422.400811:0:15081:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160312c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:81cc8122-76ce-44d6-92df-050caa660a32+5:2356:x1877722797303680:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 22us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736422.400816:0:15081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 21 00000100:00080000:2.0:1790736422.400912:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790736422.400916:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790736422.406377:0:14396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797303552 00000100:00100000:0.0:1790736422.406390:0:14396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797303552 00000100:00100000:0.0:1790736422.406626:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 29 00000100:00100000:0.0:1790736422.406637:0:14396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163380f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81cc8122-76ce-44d6-92df-050caa660a32+11:2356:x1877722797303552:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1790736422.406729:0:14396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163380f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81cc8122-76ce-44d6-92df-050caa660a32+11:2356:x1877722797303552:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 94us (6753us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736422.406737:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 29 00000100:00080000:2.0:1790736422.410421:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1790736422.555983:0:14427:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1790736422.555994:0:14427:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790736422.556030:0:14427:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1790736422.556037:0:14427:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1790736422.556186:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b782a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14427:1877722816162944:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790736422.556302:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff941612fd10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790736422.577358:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736422.577465:0:14407:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797303936 00000100:00100000:0.0:1790736422.577474:0:14407:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797303936 00000100:00100000:0.0:1790736422.577526:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 0 00000100:00100000:0.0:1790736422.577536:0:14407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160312d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+32:14507:x1877722797303936:12345-192.168.203.5@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1790736422.577628:0:14407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160312d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+32:14507:x1877722797303936:12345-192.168.203.5@tcp:900:lhsmtool_posix.0 Request processed in 93us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736422.577650:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 0 00000100:00100000:3.0:1790736422.578050:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b782a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14427:1877722816162944:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790736422.580552:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736422.581044:0:16271:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797304064 00000100:00100000:3.0:1790736422.581054:0:16271:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797304064 00000100:00100000:3.0:1790736422.581148:0:16271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 46 00000100:00100000:3.0:1790736422.581158:0:16271:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160312f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+31:14507:x1877722797304064:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790736422.581187:0:16271:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790736422.581552:0:16271:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160312f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+31:14507:x1877722797304064:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 393us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736422.581560:0:16271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 46 00000100:00100000:2.0:1790736422.584686:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736422.584786:0:14396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797304192 00000100:00100000:0.0:1790736422.584795:0:14396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797304192 00000100:00100000:0.0:1790736422.584850:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 47 00000100:00100000:0.0:1790736422.584860:0:14396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633800e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+31:14507:x1877722797304192:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1790736422.584930:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29400/0x6aae200528fe786a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.584947:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29400/0x6aae200528fe786a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.584958:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29400/0x6aae200528fe786a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.585004:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29200/0x6aae200528fe7871 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.585011:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29200/0x6aae200528fe7871 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.585018:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29200/0x6aae200528fe7871 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.585040:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7878 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.585049:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7878 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.585055:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7878 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790736422.585132:0:14396:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1790736422.585137:0:14396:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790736422.585148:0:14396:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7878 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.585159:0:14396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29400/0x6aae200528fe786a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.585166:0:14396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29400/0x6aae200528fe786a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.585173:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29400/0x6aae200528fe786a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.585179:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163be29400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736422.585183:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29400/0x6aae200528fe786a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.585190:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29400/0x6aae200528fe786a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.585201:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff941605a61d00) 00010000:00010000:0.0:1790736422.585204:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736422.585209:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29400/0x6aae200528fe786a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.585216:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29400/0x6aae200528fe786a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.585230:0:14396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29200/0x6aae200528fe7871 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.585246:0:14396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29200/0x6aae200528fe7871 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.585252:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29200/0x6aae200528fe7871 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.585256:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163be29200 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736422.585259:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29200/0x6aae200528fe7871 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.585264:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29200/0x6aae200528fe7871 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.585342:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff941605a61500) 00010000:00010000:0.0:1790736422.585344:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736422.585347:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29200/0x6aae200528fe7871 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.585353:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29200/0x6aae200528fe7871 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.585369:0:14396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7878 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.585375:0:14396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7878 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.585382:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7878 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.585387:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163be28600 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736422.585395:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7878 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.585402:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7878 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.585477:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff941605242900) 00010000:00010000:0.0:1790736422.585480:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736422.585483:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7878 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.585489:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28600/0x6aae200528fe7878 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736422.585564:0:14396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633800e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+31:14507:x1877722797304192:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 Request processed in 704us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736422.585572:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 47 00000100:00100000:2.0:1790736422.594430:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736422.594533:0:14398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797304448 00000100:00100000:1.0:1790736422.594542:0:14398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797304448 00000100:00100000:1.0:1790736422.594601:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 48 00000100:00100000:1.0:1790736422.594611:0:14398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633802a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+31:14507:x1877722797304448:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790736422.594631:0:14398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736422.594651:0:14398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe787f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a5272cd expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.594750:0:14398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60000/0x6aae200528fe7886 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.594765:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60000/0x6aae200528fe7886 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.594787:0:14398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60000/0x6aae200528fe7886 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790736422.594800:0:14398:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1790736422.594894:0:14398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60000/0x6aae200528fe7886 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.594902:0:14398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60000/0x6aae200528fe7886 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.594909:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60000/0x6aae200528fe7886 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.594915:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60000 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736422.594919:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60000/0x6aae200528fe7886 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.594926:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60000/0x6aae200528fe7886 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.594938:0:14398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff941605242900) 00010000:00010000:1.0:1790736422.594941:0:14398:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790736422.594945:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60000/0x6aae200528fe7886 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.594951:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60000/0x6aae200528fe7886 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.594992:0:14398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe787f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272cd expref: 33 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.595012:0:14398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff941605a61d00) 00010000:00010000:1.0:1790736422.595015:0:14398:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790736422.595019:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe787f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272cd expref: 33 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.595028:0:14398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c60400, rc 0) 00000100:00100000:1.0:1790736422.595090:0:14398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633802a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+32:14507:x1877722797304448:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 480us (684us total) trans 8589934619 rc 301/301 00000100:00100000:1.0:1790736422.595509:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 48 00000100:00100000:1.0:1790736422.600125:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736422.600284:0:14397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797304576 00000100:00100000:2.0:1790736422.600294:0:14397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797304576 00000100:00100000:2.0:1790736422.600356:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 49 00000100:00100000:2.0:1790736422.600366:0:14397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160312ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+32:14507:x1877722797304576:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790736422.600436:0:14397:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790736422.600578:0:14397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160312ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+32:14507:x1877722797304576:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 213us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736422.600587:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 49 00000100:00100000:2.0:1790736422.606155:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736422.606239:0:14398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797304832 00000100:00100000:1.0:1790736422.606248:0:14398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797304832 00000100:00100000:1.0:1790736422.606308:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 50 00000100:00100000:1.0:1790736422.606317:0:14398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633800380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+32:14507:x1877722797304832:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790736422.606337:0:14398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790736422.606355:0:14398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe7894 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a5272d4 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790736422.607945:0:14398:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:1.0:1790736422.607957:0:14398:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:1.0:1790736422.608037:0:14398:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:1.0:1790736422.608767:0:14398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60000/0x6aae200528fe789b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.608785:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60000/0x6aae200528fe789b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.608807:0:14398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60000/0x6aae200528fe789b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.608874:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe7894 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272d4 expref: 35 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.608893:0:14398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60000/0x6aae200528fe789b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272d4 expref: 34 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.608902:0:14398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff94162048fa00) 00010000:00010000:1.0:1790736422.608905:0:14398:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790736422.608908:0:14398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941633c60000, rc 0) 00000100:00100000:1.0:1790736422.609038:0:14398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633800380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+34:14507:x1877722797304832:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 2721us (2891us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1790736422.609047:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 50 00000100:00100000:1.0:1790736422.617213:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736422.617417:0:14397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797305088 00000100:00100000:2.0:1790736422.617488:0:14397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797305088 00000100:00100000:2.0:1790736422.617600:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 51 00000100:00100000:2.0:1790736422.617611:0:14397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160312e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+34:14507:x1877722797305088:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790736422.617668:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790736422.617695:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60000/0x6aae200528fe789b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272d4 expref: 34 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.617713:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff94162048fa00) 00010000:00010000:2.0:1790736422.617736:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790736422.617759:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931800/0x6aae200528fe78a9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.617773:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611931800/0x6aae200528fe78a9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.617782:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611931800/0x6aae200528fe78a9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.617829:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe78b0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x92cc5227 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.617838:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe78b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x92cc5227 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.617844:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe78b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x92cc5227 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.617906:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931800/0x6aae200528fe78a9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.617914:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611931800/0x6aae200528fe78a9 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.617920:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941611931800/0x6aae200528fe78a9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.617927:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941611931800 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736422.617931:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611931800/0x6aae200528fe78a9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.617938:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611931800/0x6aae200528fe78a9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.617952:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff941616119300) 00010000:00010000:2.0:1790736422.617955:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790736422.617959:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941611931800/0x6aae200528fe78a9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.617966:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931800/0x6aae200528fe78a9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.617976:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe78b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x92cc5227 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.617982:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe78b0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x92cc5227 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.617989:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe78b0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x92cc5227 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.617993:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941611930400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:2.0:1790736422.617996:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe78b0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x92cc5227 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.618002:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe78b0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x92cc5227 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.618008:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x92cc5227 (ffff941605242500) 00010000:00010000:2.0:1790736422.618010:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790736422.618013:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe78b0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x92cc5227 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.618018:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611930400/0x6aae200528fe78b0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x92cc5227 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736422.618182:0:14397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160312e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+33:14507:x1877722797305088:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 572us (976us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790736422.618189:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 51 00000100:00100000:2.0:1790736422.625849:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736422.625939:0:16271:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797305216 00000100:00100000:3.0:1790736422.625949:0:16271:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797305216 00000100:00100000:3.0:1790736422.626008:0:16271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 52 00000100:00100000:3.0:1790736422.626017:0:16271:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633803100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+33:14507:x1877722797305216:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790736422.626038:0:16271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736422.626061:0:16271:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f600/0x6aae200528fe78b7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a5272db expref: -99 pid: 16271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.626159:0:16271:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fc00/0x6aae200528fe78be lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.626174:0:16271:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fc00/0x6aae200528fe78be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.626185:0:16271:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fc00/0x6aae200528fe78be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.626288:0:16271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f600/0x6aae200528fe78b7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272db expref: 35 pid: 16271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.626306:0:16271:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fc00/0x6aae200528fe78be lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272db expref: 34 pid: 16271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.626316:0:16271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff941616119f00) 00010000:00010000:3.0:1790736422.626319:0:16271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790736422.626322:0:16271:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162156fc00, rc 0) 00000100:00100000:3.0:1790736422.626381:0:16271:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633803100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+34:14507:x1877722797305216:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 365us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736422.626389:0:16271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 52 00000100:00100000:0.0:1790736422.633508:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736422.633730:0:14396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797305472 00000100:00100000:3.0:1790736422.633740:0:14396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797305472 00000100:00100000:3.0:1790736422.633796:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 53 00000100:00100000:3.0:1790736422.633806:0:14396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+34:14507:x1877722797305472:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790736422.633885:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f600/0x6aae200528fe78c5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.633923:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f600/0x6aae200528fe78c5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.633933:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f600/0x6aae200528fe78c5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790736422.634453:0:14396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1790736422.634465:0:14396:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 494645370791ns, next at 495645367833ns, rc = 0 00000004:00010000:3.0:1790736422.634543:0:14396:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d4987963 reply state 00000000cbce0fd2 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f600/0x6aae200528fe78c5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736422.634553:0:14396:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790736422.634652:0:14396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+36:14507:x1877722797305472:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 846us (1150us total) trans 8589934621 rc 0/0 00000100:00100000:3.0:1790736422.634661:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 53 00010000:00010000:1.0:1790736422.637518:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f600/0x6aae200528fe78c5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.637535:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f600/0x6aae200528fe78c5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.637543:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f600/0x6aae200528fe78c5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.637549:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94162156f600 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736422.637554:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f600/0x6aae200528fe78c5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.637579:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f600/0x6aae200528fe78c5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.637594:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff941616119f00) 00010000:00010000:1.0:1790736422.637597:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790736422.637602:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f600/0x6aae200528fe78c5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.637608:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f600/0x6aae200528fe78c5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736422.638794:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736422.639063:0:16271:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797305600 00000100:00100000:3.0:1790736422.639073:0:16271:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797305600 00000100:00100000:3.0:1790736422.639153:0:16271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 54 00000100:00100000:3.0:1790736422.639163:0:16271:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+35:14507:x1877722797305600:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790736422.639188:0:16271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736422.639207:0:16271:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e600/0x6aae200528fe78cc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a5272e2 expref: -99 pid: 16271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.639297:0:16271:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e600/0x6aae200528fe78cc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272e2 expref: 36 pid: 16271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.639312:0:16271:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e600/0x6aae200528fe78cc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272e2 expref: 36 pid: 16271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.639341:0:16271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff941616119f00) 00010000:00010000:3.0:1790736422.639344:0:16271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790736422.639347:0:16271:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162156e600, rc 0) 00000100:00100000:3.0:1790736422.639417:0:16271:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+36:14507:x1877722797305600:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 255us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736422.639433:0:16271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 54 00000100:00100000:2.0:1790736422.642732:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736422.642816:0:15081:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797305728 00000100:00100000:3.0:1790736422.642827:0:15081:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797305728 00000100:00100000:3.0:1790736422.642883:0:15081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 12 00000100:00100000:3.0:1790736422.642892:0:15081:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941633803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+5:2355:x1877722797305728:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1790736422.643446:0:15081:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941633803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+6:2355:x1877722797305728:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 Request processed in 553us (720us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1790736422.643455:0:15081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 12 00000100:00100000:2.0:1790736422.649249:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736422.649385:0:16269:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797305984 00000100:00100000:0.0:1790736422.649394:0:16269:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797305984 00000100:00100000:0.0:1790736422.649465:0:16269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 11 00000100:00100000:0.0:1790736422.649475:0:16269:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941642041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+36:14507:x1877722797305984:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790736422.649689:0:16269:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941642041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+37:14507:x1877722797305984:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 215us (448us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1790736422.649698:0:16269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 11 00000100:00100000:2.0:1790736422.651790:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736422.651873:0:14396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797306240 00000100:00100000:3.0:1790736422.651883:0:14396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797306240 00000100:00100000:3.0:1790736422.651936:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 55 00000100:00100000:3.0:1790736422.651945:0:14396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+37:14507:x1877722797306240:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790736422.652050:0:14396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+37:14507:x1877722797306240:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 106us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736422.652058:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 55 00000100:00100000:2.0:1790736422.655296:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736422.655519:0:16271:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797306368 00000100:00100000:3.0:1790736422.655530:0:16271:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797306368 00000100:00100000:3.0:1790736422.655591:0:16271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 56 00000100:00100000:3.0:1790736422.655602:0:16271:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+37:14507:x1877722797306368:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790736422.655639:0:16271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736422.655658:0:16271:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162156ee00/0x6aae200528fe78d3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a5272e9 expref: -99 pid: 16271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.655725:0:16271:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fe00/0x6aae200528fe78da lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.655741:0:16271:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fe00/0x6aae200528fe78da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.655752:0:16271:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fe00/0x6aae200528fe78da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790736422.655789:0:16271:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790736422.655807:0:16271:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fe00/0x6aae200528fe78da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.655831:0:16271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162156ee00/0x6aae200528fe78d3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272e9 expref: 39 pid: 16271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.655848:0:16271:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fe00/0x6aae200528fe78da lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272e9 expref: 38 pid: 16271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.655856:0:16271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff941616119f00) 00010000:00010000:3.0:1790736422.655858:0:16271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790736422.655861:0:16271:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162156fe00, rc 0) 00000100:00100000:3.0:1790736422.655921:0:16271:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+38:14507:x1877722797306368:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 321us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736422.655929:0:16271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 56 00000100:00100000:1.0:1790736422.659833:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736422.660134:0:15078:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797306496 00000100:00100000:2.0:1790736422.660152:0:15078:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797306496 00000100:00100000:2.0:1790736422.660212:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 13 00000100:00100000:2.0:1790736422.660221:0:15078:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160312f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+6:2356:x1877722797306496:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790736422.660239:0:15078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790736422.660259:0:15078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4e6f428/0x6aae200528fe78e1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a5272f0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790736422.660684:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abc7827, blocks: 0x1 00010000:00010000:2.0:1790736422.660704:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=494s v=(0 0) 00010000:00010000:2.0:1790736422.660709:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790736422.660718:0:15078:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4e6f428/0x6aae200528fe78e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272f0 expref: 7 pid: 15078 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.660738:0:15078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c4e6f428/0x6aae200528fe78e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272f0 expref: 7 pid: 15078 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.660773:0:15078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff941611931200, rc 0) 00000100:00100000:2.0:1790736422.660835:0:15078:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160312f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+7:2356:x1877722797306496:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 614us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736422.660842:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 13 00000100:00100000:2.0:1790736422.664662:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736422.664752:0:14396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797306752 00000100:00100000:3.0:1790736422.664761:0:14396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797306752 00000100:00100000:3.0:1790736422.664847:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 57 00000100:00100000:3.0:1790736422.664857:0:14396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94162f267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+38:14507:x1877722797306752:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790736422.665003:0:14396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94162f267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+38:14507:x1877722797306752:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 148us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736422.665012:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 57 00000100:00100000:1.0:1790736422.667645:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736422.667732:0:16271:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797306880 00000100:00100000:3.0:1790736422.667741:0:16271:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797306880 00000100:00100000:3.0:1790736422.667821:0:16271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 58 00000100:00100000:3.0:1790736422.667831:0:16271:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160312fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+38:14507:x1877722797306880:12345-192.168.203.5@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1790736422.737731:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000001:00080000:3.0:1790736422.737764:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:3.0:1790736422.737801:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000004:00080000:3.0:1790736422.737808:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1790736422.737952:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163b782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816163072:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1790736422.738042:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736422.738148:0:15081:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816163072 00000100:00100000:3.0:1790736422.738155:0:15081:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816163072 00000100:00100000:3.0:1790736422.738214:0:15081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790736422.738222:0:15081:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163b780000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1877722816163072:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1790736422.738575:0:16271:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160312fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+13:14507:x1877722797306880:12345-192.168.203.5@tcp:44:lhsmtool_posix.0 Request processed in 70742us (70934us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736422.738584:0:16271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 58 00002000:00010000:3.0:1790736422.738868:0:15081:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1790736422.738872:0:15081:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1790736422.738874:0:15081:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1790736422.738875:0:15081:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1790736423 -> 1790736423 00002000:00010000:3.0:1790736422.738878:0:15081:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1790736422.738924:0:15081:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163b780000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1877722816163072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 702us (882us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1790736422.738936:0:15081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1790736422.738956:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1790736422.739143:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94163b782a00/2, rc 0, transno 8589934595 00000100:00100000:2.0:1790736422.739150:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163b782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1877722816163072:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1790736422.751032:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736422.751133:0:15079:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797307008 00000100:00100000:0.0:1790736422.751143:0:15079:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797307008 00000100:00100000:0.0:1790736422.751200:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 15 00000100:00100000:0.0:1790736422.751210:0:15079:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160312c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+7:2355:x1877722797307008:12345-192.168.203.5@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1790736422.751324:0:15079:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160312c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+7:2355:x1877722797307008:12345-192.168.203.5@tcp:16:lhsmtool_posix.0 Request processed in 115us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736422.751332:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 15 00000100:00100000:2.0:1790736422.769990:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736422.770137:0:14397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797307264 00000100:00100000:1.0:1790736422.770146:0:14397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797307264 00000100:00100000:1.0:1790736422.770206:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 59 00000100:00100000:1.0:1790736422.770217:0:14397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160838d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+13:14507:x1877722797307264:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790736422.770269:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736422.770298:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162156fe00/0x6aae200528fe78da lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272e9 expref: 13 pid: 16271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.770316:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff941616119f00) 00010000:00010000:1.0:1790736422.770320:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790736422.770348:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61000/0x6aae200528fe78e8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.770362:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61000/0x6aae200528fe78e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.770385:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61000/0x6aae200528fe78e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790736422.770646:0:14397:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f97d4cf2 reply state 00000000afbadde0 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61000/0x6aae200528fe78e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736422.770655:0:14397:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790736422.770797:0:14397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160838d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+14:14507:x1877722797307264:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 581us (816us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1790736422.770804:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 59 00010000:00010000:0.0:1790736422.781049:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61000/0x6aae200528fe78e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.781067:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61000/0x6aae200528fe78e8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.781075:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61000/0x6aae200528fe78e8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.781081:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c61000 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736422.781086:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61000/0x6aae200528fe78e8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.781117:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61000/0x6aae200528fe78e8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.781136:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff941616119f00) 00010000:00010000:0.0:1790736422.781139:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736422.781143:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61000/0x6aae200528fe78e8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.781150:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61000/0x6aae200528fe78e8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736422.784025:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736422.784547:0:15081:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797307392 00000100:00100000:3.0:1790736422.784558:0:15081:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797307392 00000100:00100000:3.0:1790736422.784617:0:15081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 16 00000100:00100000:3.0:1790736422.784627:0:15081:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160838e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+7:14507:x1877722797307392:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790736422.784645:0:15081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736422.784663:0:15081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c44bc229/0x6aae200528fe78ef lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a5272f7 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.784694:0:15081:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4e6f428/0x6aae200528fe78e1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272f0 expref: 8 pid: 15078 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.784703:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790736422.784856:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790736422.784863:0:15081:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c44bc229/0x6aae200528fe78ef lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272f7 expref: 8 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.784903:0:15081:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c4e6f428/0x6aae200528fe78e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0x92962417a5272f0 expref: 8 pid: 15078 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.784918:0:15081:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c4e6f428/0x6aae200528fe78e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5272f0 expref: 8 pid: 15078 timeout: 594 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736422.784932:0:15081:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163c522a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15081:1877722816163200:192.168.203.5@tcp:104: 00000100:00100000:3.0:1790736422.785079:0:15081:0:(client.c:2716:ptlrpc_set_wait()) set ffff941612fd1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790736422.789999:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736422.790109:0:14381:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797307520 00000100:00100000:1.0:1790736422.790119:0:14381:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797307520 00010000:00010000:1.0:1790736422.790158:0:14381:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c4e6f428/0x6aae200528fe78e1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5272f0 expref: 9 pid: 15078 timeout: 594 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736422.790201:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 14 00000100:00100000:1.0:1790736422.790209:0:14381:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c520e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+9:2356:x1877722797307520:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790736422.790224:0:14381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790736422.790244:0:14381:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c4e6f428/0x6aae200528fe78e1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5272f0 expref: 9 pid: 15078 timeout: 594 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.790257:0:14381:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c4e6f428/0x6aae200528fe78e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5272f0 expref: 9 pid: 15078 timeout: 594 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.790280:0:14381:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790736422.790284:0:14381:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790736422.790302:0:14381:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c44bc229/0x6aae200528fe78ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272f7 expref: 9 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.790312:0:14381:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c44bc229/0x6aae200528fe78ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272f7 expref: 9 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.790348:0:14381:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c44bc229/0x6aae200528fe78ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272f7 expref: 9 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736422.790361:0:14381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160312ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14381:1877722816163328:192.168.203.5@tcp:105: 00000100:00100000:1.0:1790736422.790458:0:14381:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611cf59c0 going to sleep for 11 seconds 00010000:00010000:0.0:1790736422.790597:0:15081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4e6f428/0x6aae200528fe78e1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5272f0 expref: 9 pid: 15078 timeout: 594 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736422.790613:0:15081:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163c522a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15081:1877722816163200:192.168.203.5@tcp:104: 00010000:00010000:0.0:1790736422.790641:0:15081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c44bc229/0x6aae200528fe78ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0x92962417a5272f7 expref: 8 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.790652:0:15081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162156ee00, rc 0) 00000100:00100000:0.0:1790736422.790684:0:15081:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160838e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+8:14507:x1877722797307392:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 6057us (6666us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736422.790691:0:15081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 16 00000100:00100000:3.0:1790736422.797238:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736422.797360:0:14381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160312ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14381:1877722816163328:192.168.203.5@tcp:105: 00010000:00010000:0.0:1790736422.797386:0:14381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790736422.797443:0:14381:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c520e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+7:2356:x1877722797307520:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 7233us (7452us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736422.797457:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 14 00000100:00100000:2.0:1790736422.799489:0:15079:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797307648 00000100:00100000:2.0:1790736422.799504:0:15079:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797307648 00000100:00100000:2.0:1790736422.799575:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 17 00000100:00100000:2.0:1790736422.799585:0:15079:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c522680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+7:2356:x1877722797307648:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1790736422.799785:0:15079:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1790736422.799790:0:15079:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1790736422 00002000:00010000:2.0:1790736422.799792:0:15079:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1790736420 00002000:00010000:2.0:1790736422.799794:0:15079:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1790736423 -> 1790736422 00002000:00010000:2.0:1790736422.799796:0:15079:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1790736422.799863:0:15079:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c522680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+8:2356:x1877722797307648:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 Request processed in 278us (2633us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1790736422.799871:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 17 00000100:00100000:3.0:1790736422.805192:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736422.805470:0:15807:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797307776 00000100:00100000:0.0:1790736422.805481:0:15807:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797307776 00000100:00100000:0.0:1790736422.805546:0:15807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18 00000100:00100000:0.0:1790736422.805557:0:15807:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c522300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+8:2355:x1877722797307776:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1790736422.805602:0:15807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000037a95876/0x6aae200528fe78f6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.805622:0:15807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c44bc229/0x6aae200528fe78ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0x92962417a5272f7 expref: 8 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.805645:0:15807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736422.805648:0:15807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790736422.805653:0:15807:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037a95876/0x6aae200528fe78f6 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.805685:0:15807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c44bc229/0x6aae200528fe78ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.5@tcp remote: 0x92962417a5272f7 expref: 8 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.805698:0:15807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c44bc229/0x6aae200528fe78ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a5272f7 expref: 8 pid: 15081 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736422.805727:0:15807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941635cf8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15807:1877722816163456:192.168.203.5@tcp:104: 00000100:00100000:0.0:1790736422.805815:0:15807:0:(client.c:2716:ptlrpc_set_wait()) set ffff941602e0c600 going to sleep for 11 seconds 00000100:00100000:0.0:1790736422.807781:0:15807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941635cf8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15807:1877722816163456:192.168.203.5@tcp:104: 00010000:00010000:0.0:1790736422.807807:0:15807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000037a95876/0x6aae200528fe78f6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736422.817627:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736422.817760:0:14383:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797307904 00000100:00100000:0.0:1790736422.817771:0:14383:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797307904 00010000:00010000:0.0:1790736422.817810:0:14383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c44bc229/0x6aae200528fe78ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a5272f7 expref: 9 pid: 15081 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736422.817860:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 15 00000100:00100000:0.0:1790736422.817869:0:14383:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c520a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+9:2356:x1877722797307904:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790736422.817902:0:14383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790736422.817924:0:14383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c44bc229/0x6aae200528fe78ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a5272f7 expref: 9 pid: 15081 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.817938:0:14383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c44bc229/0x6aae200528fe78ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.5@tcp remote: 0x92962417a5272f7 expref: 9 pid: 15081 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.817959:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c44bc229/0x6aae200528fe78ef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.5@tcp remote: 0x92962417a5272f7 expref: 9 pid: 15081 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.817976:0:14383:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790736422.817980:0:14383:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790736422.817985:0:14383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000037a95876/0x6aae200528fe78f6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.817995:0:14383:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037a95876/0x6aae200528fe78f6 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.818029:0:14383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790736422.818079:0:14383:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c520a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+8:2356:x1877722797307904:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 210us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736422.818087:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 15 00010000:00010000:2.0:1790736422.818378:0:15807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000037a95876/0x6aae200528fe78f6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.818400:0:15807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037a95876/0x6aae200528fe78f6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.818435:0:15807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000037a95876/0x6aae200528fe78f6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.818444:0:15807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037a95876/0x6aae200528fe78f6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.818452:0:15807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037a95876/0x6aae200528fe78f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.818459:0:15807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163be29200 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:2.0:1790736422.818463:0:15807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037a95876/0x6aae200528fe78f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.818472:0:15807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037a95876/0x6aae200528fe78f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.818485:0:15807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037a95876/0x6aae200528fe78f6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.818491:0:15807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037a95876/0x6aae200528fe78f6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736422.818556:0:15807:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c522300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+7:2355:x1877722797307776:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 13002us (13372us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736422.818564:0:15807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18 00000100:00100000:3.0:1790736422.828203:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736422.828367:0:14398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797308160 00000100:00100000:1.0:1790736422.828377:0:14398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797308160 00000100:00100000:1.0:1790736422.828442:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 60 00000100:00100000:1.0:1790736422.828452:0:14398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+13:14507:x1877722797308160:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1790736422.828532:0:14398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe78fd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.828550:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe78fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.828561:0:14398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe78fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.828821:0:14398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7904 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.828833:0:14398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e600/0x6aae200528fe78cc lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272e2 expref: 14 pid: 16271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.828851:0:14398:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7904 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.828882:0:14398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e600/0x6aae200528fe78cc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0x92962417a5272e2 expref: 14 pid: 16271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.828896:0:14398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e600/0x6aae200528fe78cc lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5272e2 expref: 14 pid: 16271 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736422.828909:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160312dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14398:1877722816163584:192.168.203.5@tcp:104: 00000100:00100000:1.0:1790736422.829001:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff941611cf5e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790736422.831922:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736422.832601:0:16511:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797308288 00000100:00100000:2.0:1790736422.832611:0:16511:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797308288 00010000:00010000:2.0:1790736422.832652:0:16511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e600/0x6aae200528fe78cc lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5272e2 expref: 15 pid: 16271 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790736422.832695:0:16511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 16 00000100:00100000:2.0:1790736422.832716:0:16511:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c520000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+15:2355:x1877722797308288:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790736422.832732:0:16511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790736422.832739:0:16511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e600/0x6aae200528fe78cc lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5272e2 expref: 15 pid: 16271 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.832751:0:16511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e600/0x6aae200528fe78cc lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5272e2 expref: 15 pid: 16271 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.832772:0:16511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff941616119f00) 00010000:00010000:2.0:1790736422.832777:0:16511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7904 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.832788:0:16511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7904 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.832795:0:16511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7904 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790736422.832831:0:16511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790736422.832888:0:16511:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c520000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+15:2355:x1877722797308288:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 183us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736422.832895:0:16511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 16 00010000:00010000:1.0:1790736422.833165:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e600/0x6aae200528fe78cc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0x92962417a5272e2 expref: 14 pid: 16271 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736422.833183:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160312dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14398:1877722816163584:192.168.203.5@tcp:104: 00010000:00010000:1.0:1790736422.833204:0:14398:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7904 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.833213:0:14398:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7904 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.833219:0:14398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7904 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790736422.833370:0:14398:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:1.0:1790736422.833515:0:14398:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:1.0:1790736422.833562:0:14398:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:1.0:1790736422.833658:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94160312dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14398:1877722816163712:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1790736422.833880:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790736422.833915:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff94161871a480 going to sleep for 11 seconds 00000100:00100000:0.0:1790736422.833992:0:14401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816163712 00000100:00100000:0.0:1790736422.833997:0:14401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816163712 00000100:00100000:0.0:1790736422.834031:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790736422.834039:0:14401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160312f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14398:x1877722816163712:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1790736422.834155:0:14401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160312f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14398:x1877722816163712:12345-0@lo:1000:mdt00_002.0 Request processed in 116us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736422.834162:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790736422.834623:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94160312dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14398:1877722816163712:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1790736422.835321:0:14398:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:3.0:1790736422.835396:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163c523480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14398:1877722816163840:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1790736422.835472:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736422.835509:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff94161871a480 going to sleep for 11 seconds 00000100:00100000:2.0:1790736422.835656:0:14401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816163840 00000100:00100000:2.0:1790736422.835663:0:14401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816163840 00000100:00100000:2.0:1790736422.835704:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790736422.835876:0:14401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14398:x1877722816163840:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1790736422.836047:0:14401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14398:x1877722816163840:12345-0@lo:1000:mdt00_002.0 Request processed in 173us (574us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1790736422.836142:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163c523480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14398:1877722816163840:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1790736422.836175:0:14398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7904 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.836185:0:14398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7904 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.836192:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7904 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.836198:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c61800 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736422.836201:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7904 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.836209:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7904 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.836235:0:14398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff941616119f00) 00010000:00010000:3.0:1790736422.836238:0:14398:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790736422.836242:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7904 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.836248:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c61800/0x6aae200528fe7904 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.836275:0:14398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff941611931e00/0x6aae200528fe785c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.836282:0:14398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941611931e00/0x6aae200528fe785c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.836287:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941611931e00/0x6aae200528fe785c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.836292:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941611931e00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:3.0:1790736422.836294:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611931e00/0x6aae200528fe785c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.836300:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941611931e00/0x6aae200528fe785c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.836307:0:14398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff941605242900) 00010000:00010000:3.0:1790736422.836309:0:14398:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790736422.836316:0:14398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e400/0x6aae200528fe7863 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272c6 expref: 17 pid: 16271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.836326:0:14398:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e400/0x6aae200528fe7863 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272c6 expref: 17 pid: 16271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.836341:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e400/0x6aae200528fe7863 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272c6 expref: 17 pid: 16271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.836393:0:14398:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff94162156e400/0x6aae200528fe7863 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272c6 expref: 17 pid: 16271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790736422.836414:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163c520700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14398:1877722816163968:192.168.203.5@tcp:105: 00000100:00100000:3.0:1790736422.836476:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff94161871a480 going to sleep for 11 seconds 00000100:00100000:2.0:1790736422.839479:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790736422.841426:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163c520700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14398:1877722816163968:192.168.203.5@tcp:105: 00010000:00010000:1.0:1790736422.841460:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941611931e00/0x6aae200528fe785c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.841472:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941611931e00/0x6aae200528fe785c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.841506:0:14398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe790b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.841520:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe790b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.841531:0:14398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe790b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.841553:0:14398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe790b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.841560:0:14398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe790b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.841567:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe790b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.841573:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60400 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736422.841577:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe790b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.841599:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe790b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.841611:0:14398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff941605242900) 00010000:00010000:1.0:1790736422.841614:0:14398:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790736422.841618:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe790b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.841624:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60400/0x6aae200528fe790b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.841634:0:14398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe78fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.841640:0:14398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe78fd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.841646:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe78fd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.841651:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60a00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:1.0:1790736422.841654:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe78fd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.841660:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe78fd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.841666:0:14398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff941605242900) 00010000:00010000:1.0:1790736422.841669:0:14398:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790736422.841671:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe78fd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.841687:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe78fd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790736422.841927:0:14398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+17:14507:x1877722797308160:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 13474us (13730us total) trans 8589934628 rc 0/0 00000100:00100000:1.0:1790736422.841938:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 60 00000020:00080000:1.0:1790736422.841943:0:14398:0:(tgt_main.c:787:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1790736422.842928:0:14427:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1790736422.842934:0:14427:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790736422.842964:0:14427:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1790736422.842969:0:14427:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1790736422.850587:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736422.850741:0:14399:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797308416 00000100:00100000:1.0:1790736422.850752:0:14399:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797308416 00000100:00100000:1.0:1790736422.850812:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 12 00000100:00100000:1.0:1790736422.850821:0:14399:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+17:14506:x1877722797308416:12345-192.168.203.5@tcp:49:bash.0 00000100:00100000:1.0:1790736422.850945:0:14399:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+17:14506:x1877722797308416:12345-192.168.203.5@tcp:49:bash.0 Request processed in 125us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736422.850952:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 12 00000100:00100000:2.0:1790736422.853799:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736422.853892:0:14400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797308672 00000100:00100000:1.0:1790736422.853903:0:14400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797308672 00000100:00100000:1.0:1790736422.853957:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 13 00000100:00100000:1.0:1790736422.853967:0:14400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160838ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+17:14507:x1877722797308672:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1790736422.854666:0:14400:0:(mdd_object.c:4180:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1790736422.854773:0:14400:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:1.0:1790736422.854816:0:14400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe7912 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14400 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.854833:0:14400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe7912 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14400 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.854844:0:14400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe7912 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14400 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.854859:0:14400:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe7912 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14400 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.854866:0:14400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe7912 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14400 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.854872:0:14400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe7912 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14400 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790736422.854895:0:14400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790736422.854979:0:14400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160838ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+19:14507:x1877722797308672:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 1011us (1186us total) trans 8589934630 rc 0/0 00000100:00100000:1.0:1790736422.854987:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 13 00000020:00080000:1.0:1790736422.854992:0:14400:0:(tgt_main.c:787:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790736422.855057:0:14385:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790736422.855076:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe7912 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14400 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.855084:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff941633c60a00 already unused, calling callback (ffffffffc15b7ac0) 00010000:00010000:3.0:1790736422.855087:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe7912 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14400 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.855116:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe7912 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14400 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.855130:0:14385:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff941616119f00) 00010000:00010000:3.0:1790736422.855134:0:14385:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790736422.855138:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe7912 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14400 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.855155:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff941633c60a00/0x6aae200528fe7912 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14400 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736422.855169:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736422.855171:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790736422.855173:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790736422.857804:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736422.857896:0:15079:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797308800 00000100:00100000:0.0:1790736422.857907:0:15079:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797308800 00000100:00100000:0.0:1790736422.857961:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 19 00000100:00100000:0.0:1790736422.857970:0:15079:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160838df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+7:14506:x1877722797308800:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:0.0:1790736422.857988:0:15079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790736422.858009:0:15079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000918ad74f/0x6aae200528fe7919 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a5272fe expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790736422.858036:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6abc7826, atime: 0x6abc7824, ctime: 0x6abc7826, blocks: 0x1 00010000:00010000:0.0:1790736422.858057:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1790736422.858062:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790736422.858072:0:15079:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000918ad74f/0x6aae200528fe7919 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272fe expref: 8 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.858088:0:15079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000918ad74f/0x6aae200528fe7919 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a5272fe expref: 8 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736422.858123:0:15079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94163be29e00, rc 0) 00000100:00100000:0.0:1790736422.858180:0:15079:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160838df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+8:14506:x1877722797308800:12345-192.168.203.5@tcp:101:bash.0 Request processed in 211us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736422.858186:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 19 00000100:00100000:0.0:1790736422.862520:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1790736422.862639:0:16269:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797309056 00000100:00100000:2.0:1790736422.862650:0:16269:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797309056 00000100:00100000:2.0:1790736422.862706:0:16269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 14 00000100:00100000:2.0:1790736422.862715:0:16269:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+19:14506:x1877722797309056:12345-192.168.203.5@tcp:35:bash.0 00000001:00080000:2.0:1790736422.862983:0:16269:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:2.0:1790736422.863071:0:16269:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:2.0:1790736422.863230:0:16269:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+22:14506:x1877722797309056:12345-192.168.203.5@tcp:35:bash.0 Request processed in 515us (718us total) trans 8589934633 rc 0/0 00000100:00100000:2.0:1790736422.863239:0:16269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 14 00000020:00080000:2.0:1790736422.863245:0:16269:0:(tgt_main.c:787:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1790736422.997732:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790736423.007740:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1790736423.007829:0:14396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797309312 00000100:00100000:3.0:1790736423.007839:0:14396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797309312 00000100:00100000:3.0:1790736423.007914:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 61 00000100:00100000:3.0:1790736423.007925:0:14396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94160838fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+22:14518:x1877722797309312:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1790736423.007948:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790736423.007970:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f600/0x6aae200528fe7920 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x92962417a527305 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790736423.008058:0:14396:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1790736423.008202:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f600/0x6aae200528fe7920 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527305 expref: 24 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736423.008216:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff941616119700) 00010000:00010000:3.0:1790736423.008219:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790736423.008224:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94162156f600/0x6aae200528fe7920 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0x92962417a527305 expref: 24 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790736423.008240:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94162156f600, rc 0) 00000100:00080000:2.0:1790736423.008447:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790736423.008942:0:14396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94160838fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+23:14518:x1877722797309312:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1016us (1208us total) trans 8589934634 rc 301/301 00000100:00100000:3.0:1790736423.008951:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 61 00000100:00100000:3.0:1790736423.015934:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1790736423.016033:0:16271:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797309440 00000100:00100000:0.0:1790736423.016042:0:16271:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797309440 00000100:00100000:0.0:1790736423.016127:0:16271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 62 00000100:00100000:0.0:1790736423.016138:0:16271:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+23:14518:x1877722797309440:12345-192.168.203.5@tcp:34:lfs.0 00010000:00010000:0.0:1790736423.016213:0:16271:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28e00/0x6aae200528fe792e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736423.016232:0:16271:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28e00/0x6aae200528fe792e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736423.016244:0:16271:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28e00/0x6aae200528fe792e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736423.016258:0:16271:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29a00/0x6aae200528fe7935 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736423.016275:0:16271:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29a00/0x6aae200528fe7935 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736423.016281:0:16271:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29a00/0x6aae200528fe7935 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736423.016732:0:16271:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28800/0x6aae200528fe793c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736423.016742:0:16271:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28800/0x6aae200528fe793c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736423.016748:0:16271:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28800/0x6aae200528fe793c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790736423.016786:0:16271:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28800/0x6aae200528fe793c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736423.016806:0:16271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28e00/0x6aae200528fe792e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736423.016813:0:16271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28e00/0x6aae200528fe792e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736423.016819:0:16271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28e00/0x6aae200528fe792e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736423.016825:0:16271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163be28e00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736423.016830:0:16271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28e00/0x6aae200528fe792e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736423.016837:0:16271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28e00/0x6aae200528fe792e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736423.016850:0:16271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff941616119300) 00010000:00010000:0.0:1790736423.016853:0:16271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736423.016857:0:16271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28e00/0x6aae200528fe792e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736423.016863:0:16271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28e00/0x6aae200528fe792e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736423.016875:0:16271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29a00/0x6aae200528fe7935 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736423.016881:0:16271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29a00/0x6aae200528fe7935 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736423.016887:0:16271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29a00/0x6aae200528fe7935 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736423.016898:0:16271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163be29a00 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736423.016901:0:16271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29a00/0x6aae200528fe7935 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736423.016908:0:16271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29a00/0x6aae200528fe7935 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736423.016916:0:16271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff941605a61200) 00010000:00010000:0.0:1790736423.016918:0:16271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736423.016921:0:16271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29a00/0x6aae200528fe7935 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736423.016928:0:16271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163be29a00/0x6aae200528fe7935 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736423.016944:0:16271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28800/0x6aae200528fe793c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736423.016950:0:16271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28800/0x6aae200528fe793c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736423.016956:0:16271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28800/0x6aae200528fe793c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736423.016961:0:16271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94163be28800 already unused, calling callback (ffffffffc20364f0) 00010000:00010000:0.0:1790736423.016963:0:16271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28800/0x6aae200528fe793c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736423.016969:0:16271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28800/0x6aae200528fe793c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736423.016987:0:16271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff941605242900) 00010000:00010000:0.0:1790736423.016990:0:16271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790736423.016993:0:16271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28800/0x6aae200528fe793c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790736423.016999:0:16271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94163be28800/0x6aae200528fe793c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16271 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790736423.019298:0:16271:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+23:14518:x1877722797309440:12345-192.168.203.5@tcp:34:lfs.0 Request processed in 3151us (3361us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736423.019313:0:16271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 62 00000100:00100000:0.0:1790736423.026733:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1790736423.026819:0:14399:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722797309696 00000100:00100000:1.0:1790736423.026829:0:14399:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722797309696 00000100:00100000:1.0:1790736423.026900:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 15 00000100:00100000:1.0:1790736423.026911:0:14399:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+23:14518:x1877722797309696:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:1.0:1790736423.027373:0:14399:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8fa9af14-c6db-4fd8-ba33-7fb937b5df25+24:14518:x1877722797309696:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 462us (647us total) trans 8589934635 rc 0/0 00000100:00100000:1.0:1790736423.027382:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 15 00010000:00010000:1.0:1790736424.028694:0:16095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790736424.455295:0:16660:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:3.0:1790736425.045372:0:14385:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790736425.626899:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163c521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd61a3fa-9892-475c-9015-fd1ddc473c5e:3309:1877722816164096:0@lo:400:kworker.0 00000100:00100000:3.0:1790736425.626994:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736425.627241:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163c521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1877722816164608:0@lo:400:kworker.0 00000100:00100000:3.0:1790736425.627345:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736425.627392:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790736425.627462:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163c522d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877722816164480:0@lo:400:kworker.0 00000100:00100000:3.0:1790736425.627492:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790736425.627549:0:14389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816164096 00000100:00100000:3.0:1790736425.627561:0:14389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816164096 00000100:00100000:2.0:1790736425.627651:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1790736425.627670:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163c520380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816164224:0@lo:400:kworker.0 00000100:00100000:2.0:1790736425.627700:0:14390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941603fba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+19:3309:x1877722816164096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736425.627709:0:14397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816164608 00000100:00100000:3.0:1790736425.627716:0:14397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816164608 00000100:00100000:0.0:1790736425.627728:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736425.627764:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163c521c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1877722816164736:0@lo:400:kworker.0 00000100:00100000:0.0:1790736425.627811:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736425.627822:0:14390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941603fba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd61a3fa-9892-475c-9015-fd1ddc473c5e+19:3309:x1877722816164096:12345-0@lo:400:kworker.0 Request processed in 137us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736425.627835:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1790736425.627850:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1790736425.627862:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94163c523100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816164352:0@lo:400:kworker.0 00000100:00100000:0.0:1790736425.627898:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790736425.627923:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff941635cf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816164864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790736425.627955:0:15807:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816164224 00000100:00100000:0.0:1790736425.627962:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790736425.627969:0:15807:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816164224 00000100:00100000:2.0:1790736425.628042:0:15807:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816164352 00000100:00100000:2.0:1790736425.628047:0:15807:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816164352 00000100:00100000:0.0:1790736425.628069:0:15081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790736425.628083:0:15081:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff941635cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816164224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736425.628145:0:15807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790736425.628159:0:15807:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1877722816164352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790736425.628221:0:14397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816164480 00000100:00100000:3.0:1790736425.628231:0:14397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816164480 00000100:00100000:0.0:1790736425.628237:0:15081:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff941635cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1877722816164224:12345-0@lo:400:kworker.0 Request processed in 156us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736425.628248:0:15081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790736425.628350:0:14397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816164736 00000100:00100000:3.0:1790736425.628355:0:14397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816164736 00000100:00100000:3.0:1790736425.628376:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790736425.628394:0:14397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877722816164608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736425.628419:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790736425.628429:0:14398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163c520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877722816164480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790736425.628853:0:15807:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1877722816164352:12345-0@lo:400:kworker.0 Request processed in 696us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1790736425.628862:0:15807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1790736425.628892:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790736425.628896:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790736425.628898:0:14392:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790736425.628976:0:15083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877722816164864 00000100:00100000:1.0:1790736425.628983:0:15083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877722816164864 00000100:00100000:1.0:1790736425.629237:0:15083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790736425.629248:0:15083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1877722816164864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790736425.629376:0:15083:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790736425.629457:0:15083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1877722816164864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 212us (1501us total) trans 0 rc 0/0 00000100:00100000:1.0:1790736425.629465:0:15083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790736425.630565:0:14398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877722816164480:12345-0@lo:400:kworker.0 Request processed in 2128us (3063us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736425.630579:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790736425.630616:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790736425.630628:0:14398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94163ae38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877722816164736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790736425.630683:0:14398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163ae38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877722816164736:12345-0@lo:400:kworker.0 Request processed in 60us (2877us total) trans 0 rc 0/0 00000100:00100000:0.0:1790736425.630689:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790736425.630825:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163c523100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816164352:0@lo:400:kworker.0 00000100:00100000:0.0:1790736425.630849:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff941635cf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816164864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790736425.630864:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163c520380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1877722816164224:0@lo:400:kworker.0 00000100:00100000:0.0:1790736425.630877:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163c521c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1877722816164736:0@lo:400:kworker.0 00000100:00100000:3.0:1790736425.635578:0:14397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94163c523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877722816164608:12345-0@lo:400:kworker.0 Request processed in 7180us (8218us total) trans 0 rc 0/0 00000100:00100000:3.0:1790736425.635599:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790736425.636240:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163c522d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877722816164480:0@lo:400:kworker.0 00000100:00100000:3.0:1790736425.636257:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163c521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd61a3fa-9892-475c-9015-fd1ddc473c5e:3309:1877722816164096:0@lo:400:kworker.0 00000100:00100000:3.0:1790736425.636338:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94163c521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1877722816164608:0@lo:400:kworker.0 00000001:00080000:3.0:1790736425.726416:0:7658:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:3.0:1790736425.726450:0:7658:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00010000:00010000:0.0:1790736426.077397:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29736 lines, 29736 kept, 0 dropped, 0 bad.